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This  regulation  Is  divided  Into  two  volumes:  a basic  guidance  document  on 
logistics  assessment  (Volume  I)  and  supporting  appendixes  (Volume  II).  The 
appendixes  are  numbered  In  a manner  that  keys  them  to  the  chapter  and  section 
of  the  text  to  which  they  apply.  For  example,  appendix  4-2A  Is  applicable  to 
chapter  4,  section  2;  with  the  "A"  In  the  appendix  number  denoting  that  the 
appendix  Is  the  first  one  referenced  In  that  section. 
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INTRODUCTION 


1-1.  OBJECTIVES. 

Objectives  of  this  document  are  to  provide  information  that  will  support  the 
preparation  for  and  performance  of  logistics  assessment:  present  criteria  in  the 
areas  of  data  requirements,  collection,  analysis,  and  reporting;  and  serve  as  a 
logistics  assessment  training  guide.  Much  information  pertaining  to  the  evalua- 
tion of  logistics  factors  is  already  available  in  Air  Force  regulations,  manuals, 
reports,  and  texts.  The  puipose  of  this  document  is  to  combine  the  relevant 
portions  of  those  numerous  sources  into  a single  reference  for  logistics  assess- 
ment. Sheer  volume  precludes  such  a reference  from  being  all-encompassing; 
therefore,  supplementary  sources  of  information  are  cited  as  appropriate 
throughout  the  text. 

1-2.  ORGANIZATION. 

This  document  is  organized  into  seven  chapters  with  suppoiting  appendixes. 
Subsequent  sections  of  this  introductory  chapter  discuss  the  basic  approach  to 
developing  the  document,  and  in  using  standardized  terminology. 

a.  Chapter  2 addresses  how  this  document  can  be  vitllized  most  effec- 
tively, i.e. , who  should  use  it  and  when. 

b.  Chapter  3 discusses  specific  applications  to  Operational  Test  and 
Evaluation  (OT&E),  the  system  development  phase  in  which  a realistic 
logistic  assessment  can  first  be  conducted. 

c.  Chapter  4 presents  the  technical  aspects  of  logistics  assessment. 

That  chapter: 

(1)  Defines  logistics-related  measures  of  effectiveness  in  terms  of 
parameters,  data  elements,  and  definitions; 

(2)  Discusses  cost-of-ownership  and  software  considerations  in 
logistics  assessment; 

* (3)  Presents  data  collection  forms  and  formats,  along  with  a sum- 

mary of  the  data  elements  obtainable  from  each  form; 

*.  (4)  Discusses  data  sources  and  the  impact  of  configuration  manage- 

ment on  test  programs; 

i (5)  Describes  data  reduction  and  analysis  techniques,  including 

criteria  and  ground  rules  and  equations  for  the  listed  parameters; 
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(fi)  Outlines  statistical  techniques  for  logistics  assessment; 


(7)  Discusses  Air  Force  data  systems  and  their  products  applicable 
to  logistics  assessment; 

(8)  Describes  qualitative  evaluation  of  test  results  applicable  to 
logistics  assessment,  including  the  utility  of  these  evaluations,  test  situations 
requiring  these  evaluations,  and  application  of  the  qualitative  process; 

d.  Chapter  5 (to  be  developed)  will  present  practical  applications  of  the 
techniques  discussed  in  chapter  4, 

e.  Chapter  6 (to  be  developed)  will  provide  standard  Air  Force  reliability 
and  maintainability  terms. 

f.  Supplemental  information  (chapter  7)  Includes  a listing  of  acronyms 
and  abbreviations  contained  in  this  document,  a reiteration  of  the  major  terms 
and  definitions  utilized,  and  a listing  of  documents  used  in  preparing  this  docu- 
ment as  well  as  references  where  additional  information  on  selected  subjects 
can  be  obtained. 

g.  The  appendixes,  which  appear  in  a separate  volume,  provide  infor- 
mation in  support  of  the  text  of  chapter  4. 

1-3.  DEVELOPMENT. 

a.  The  amount  of  use  received  by  a document  is  determined  by  what 
information  it  contains  and  how  that  information  is  presented.  Two  general 
methods  of  presentation  are  functional  orientation  and  product  orientation.  The 
functional  method  utilizes  a chronological  ordering  of  the  information,  and  pro- 
vides an  overall  approach  for  using  the  material  presented.  The  second 
method  addresses  the  application  of  the  material  presented  to  specific  items  of 
interest.  The  functional  approach  was  used  in  the  development  of  this  document, 
the  primary  reason  being  that  the  other  approach  requires  an  excessive  repe- 
tition of  material  to  cover  the  variety  of  end  items  that  may  undergo  testing. 
Some  product  orientation  has  been  provided  through  the  use  of  matrices  and  the 
identification  of  information  applicable  to  specific  types  of  end  items. 

b.  This  document  was  developed  through  the  following  series  of  tasks; 

(1)  From  a review  of  DoD  and  Air  Force  documents  and  special 
reports,  the  most  widely  used  parameters  for  logistics  assessment  were 
collected. 

(2)  The  data  elements  required  to  evaluate  these  parameters  were 
determined. 

(3)  Data  collection  forms  and  formats  that  would  provide  the  required 
data  elements  were  identified. 
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(4)  Criteria  and  Kround  rules  for  data  reduction  and  analysis,  and 
the  equations  for  calculatlnR  the  parameters  were  delineated. 

(5)  A review  and  analysis  was  performed  on  10  Air  I'orcc  data 
systems  In  terms  of  data  sources,  output  products,  and  Interfaces  with  other 
systems,  AlRoiithms  and  equations  associated  with  these  systems  were  Identi- 
fied, and  a description  of  qualitative  evaluations,  their  utility,  and  applieotion 
was  prepared. 

(r>)  Test  reportlnR  was  addressed  and  supporting  documentation 

compiled. 

1-4,  TKUMINCIXK'.Y  STANDARDIZATION. 

a.  Considera!)le  effort  has  been  expended  by  DoD  and  the  Air  I'oi'ce 
toward  standardizing  the  terminology  associated  with  the  assessment  of 
logistics  performance.  One  product  of  this  effort  is  MIL-STD-721R,  D('finitions 
of  Kffectiveness  Terms.  Many  of  the  terms  defined  in  that  standard  that  relate 
to  the  description  and  evaluation  of  system  effectiveness  are  also  applicable  to 
logistics  assessment.  The  Air  Force  Logistics  Command  has  developed  a 
pamphlet.  Logistics  Performance  Factors  in  Integrated  Logistics  Support 
(AFLCP  800- ill,  that  identifies  standard  factors  for  use  in  quantifying  logistics 
performance.  During  1971,  a joint  AFLC-AFSC  Panel  .'14  reported  on  an 
analysis  of  Air  Force  data  systems  to  define  the  requirements  for  a single- 
thread data  system,  and  recommended  standard  definitions  for  parameters  and 
data  elements  associated  with  reliability  and  maintainability.  Some  recom- 
mendations were  adopted.  However,  even  today  there  are  four  different 
sources  of  data  on  maintenance  man-hours  per  flying  hour:  the  Maintenance 
Data  Collection  System  (MDCS)  as  used  at  base  level,  the  Command  Aircraft 
Maintenance  Manpower  Information  System  (CAMMIS),  AFLC's  Dd.'ifi  Product 
Performance  System,  and  the  T.oglstlcs  Performance  Measurement  and  evalua- 
tion System  (T.PMFS).  All  four  sources  provide  different  Mll/FM  values. 

b.  As  a result  of  14  December  1974  direction  from  Major  ('.eneral 
William  R.  Hayes,  then  Director  of  Maintenance  engineering  and  Supply,  Head- 
quarters HSAF,  a joint  AFSC/AFLC/AFTKC  reliability  and  maintainability 
(iKt-M)  verification  group  was  formed  under  the  aegis  of  USAF/LCiYF  to  focus 
the  test  and  evaluation  RK,M  efforts  on  operational  requirements  rather  than 
just  contract  requirements.  This  dictated  that  agreement  be  reached  on 
standard  terms  and  definitions  that  would  apply  to  IxHh  Developmental  Test  and 
evaluation  and  Operational  Test  and  Evaluation  activities. 

e.  Terms,  definitions,  and  computational  procedures  In  chapter  4 are 
those  In  common  use  throughout  the  Air  Force.  Terms,  definitions,  and  com- 
putational procedures  in  chapter  fi  (to  be  developed)  will  be  those  applierl  by 
AFTEC  to  various  types  of  test  articles.  Chapter  fi  (to  be  developed)  will 
contain  the  standaixi  Air  Force  terms,  definitions,  and  computational  procedures 
to  be  applied  Incrementally  to  new  test  programs  during  the  acquisition  process. 
While  certain  terms  within  these  chapters  will  be  unique  to  the  application  being 
discussed,  considerable  commonality  will  be  evident. 
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(I.  TiM-nis  nro  (loflniMl  In  this  documont,  for  clarity  of  imderstnndlng  and 
completeness  of  Information.  The  order  hf  precedence  In  deflnlns  these  terms 
was  to  use,  first,  those  definitions  published  as  standards  by  l>on  and  the  Air 
Force;  next,  those  recommended  ns  standards;  and  finally,  those  considered 
test-program  unique.  In  specific  cases,  special  definitions  were  developed. 
Terms  and  definitions  are  provided  thwuRhout  this  document. 
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CHAPTER  2 

I)(X:UMENT  UTILIZATION 


2-1.  WHO  SHOULD  USE  THE  DOCUMENT. 

a.  This  document  was  prepared  lor  use  primarily  hv  Logistics  Director- 
ate (LC5)  personnel  assigned  to  Operational  Test  and  Evaluation  ((/I'&E)  programs. 
However,  Its  utility  Is  not  limited  to  LG  applications.  The  Information  con- 
tained herein  provides  a common  framework  for  understanding  of  the  logistics 
aspects  of  OT&E  by  other  AETEC  directorates,  ns  well  as  test  team  personnel 
from  the  major  support  and  using  commands.  Personnel  assigned  to  data  col- 
lection, reduction,  and  analysis  efforts  will  find  useful  information,  as  will 
those  tasked  to  compile  test  results.  The  preponderance  of  information  is 
directed  toward  performing  the  activities  defined  In  AETEC  Regulation  r)r)-l  for 
the  Logistics  Directorate.  These  activities  Include: 

(1)  Assist  (in  conjunction  with  the  test  director/deputy  test  director 
and  test  manager,  the  OT&E  test  team  and  Major  Command  (MA.TCOM)  per- 
sonnel, as  appropriatej  in  preparing  the  logistics  sections  of  test  plans/reports 
to  ensure  valid  assessments  of  reliability,  maintainability,  availability,  and 
logistics  supportablllty  of  test  articles. 

(2)  Review  test  plans  and  program  documentation  to  ensure  that; 

(a>  Requirements  are  defined  and  procedures  are  identified  b' 
provide  a comprehensive  reliability,  maintainability,  availability,  and  logistics 
supportablllty  evaluation  data  base. 

(b)  AssU.tance  Is  provided  to  collect  and  process  data  for  cost  of 
ownership  and  manpower  assessments. 

(c)  Logistics  support  requirements  and  the  methods  for  provid- 
ing them  arc  identified. 

(3)  Assist  the  test  director/deputy  test  director  and  test  managers  in 
the  selection  of  maintenance  skills  required  for  an  effective  test  team. 

(4)  Assist  the  test  director/deputy  test  director  and  test  manager  to 
ensure  that  logistics  objectives  have  been  achieves!  in  conducting  an  Air  I'orce 
Test  and  Evaluation  Center  (AETEC)  test  program. 

(5)  Provide  a member  to  the  HQ  AETEC  test  team  element  for 
A FTEC-conducted  test  programs. 

(fi)  Provide  a member  to  the  HQ  AETEC  working  group  on  an 
as-required  basis  for  A ETF;C-monltored  test  programs. 

(7)  Provide  an  LG  member  to  the  AETEC  rt'vlew  Ix^ard. 
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(S)  Assist  the  tost  team  In  review  and  analysis  of  test  data  and  In  the 
formulation  of  assessment  comments  concerning  reliability,  maintainability, 
availability,  and  logistics  supportablllty  of  test  articles. 

2-2.  HOW  TO  USE  THE  DOCUMENT. 

a.  The  document  Is  structured  In  a logical  sequence  for  performing  an 
overall  logistics  assessment.  Its  use  can  best  be  Illustrated  by  a general  dis- 
cussion of  Logistics  Directorate  activities  associated  with  an  OT&E  program. 

(1)  Involvement  begins  when  AFTEC  Is  tasked  to  manage  a test  pro- 
gram. Early  program  efforts  Include  the  preparation.  In  conjunction  with  the 
operating  and  supporting  commands,  of  OT&E  Inputs  to  the  draft  Test  anti 
Evaluation  Objectives  Annex  (TEOA).  The  Initial  AFTEC-prepared  document 
for  the  management  of  a program  Is  the  Test  Program  Outline  (TPO).  The 
Logistics  Directorate  may  be  Involved  In  providing  Inputs  to  these  documents. 
Section  4-2  provides  a ready  reference  for  Identifying  logistics  parameters  that 
may  require  evaluation.  Additionally,  that  section  identifies  data  elements 
associated  with  these  parameters  and  presents  definitions  of  the  parameters  and 
data  elements. 

(2)  Detailed  use  of  this  document  will  generally  start  with  the  prepar- 
ation of  the  Logistics  Assessment  Plan  (LAP),  which  is  usually  an  appendix  to 
Annex  E (Operational  Suitability  Test  Procedures)  of  the  AFTEC  OT&E  plan. 

The  general  contents  of  and  the  principles  for  developing  the  LAP  are  discussed 
in  subsection  ;i-2c.  The  following  paragraphs  describe  typical  usage  during  the 
preparation  of  the  LAP. 

(a)  Review  program  documentation  for  specific  quantitative 
reliability,  maintainability,  availability,  and  supportablllty  parameters  to  be 
evaluated  during  OT&E.  If  the  required  Information  Is  not  available  from  this 
source,  the  using  command  should  be  asked  to  provide  It. 

(b)  Review  section  4-2  of  this  document  to  determine  If  additional 
parameters  should  be  Included. 

(c)  Itemize  the  logistics  parameters  to  be  evaluated. 

(d)  Determine  which  parameters  (if  any)  are  defined  In  the  pro- 
gram documentation. 

(e)  Compare  all  program  defined  parameters  with  the  definitions 
given  In  section  4-2. 

(f)  Use  the  definitions  In  section  4-2  as  AFTEC  standards,  and 
resolve  any  conflicts  between  these  and  program  definitions. 

(g)  Identify,  from  section  4-4,  data  elements  required  to  calcu- 
late each  parameter. 

(h)  Review  forms  already  selected  for  test  program  usage  to 
determine  their  data  contents. 


(i)  Identify  from  section  4-3  the  primary  forms  that  will  provide 
the  required  logistics  data  elements.  Also  review  supplementary  forms  appli- 
cable to  logistics  testing. 

(j)  Indicate  the  data  elements  that  must  be  collected  on  each 
form  for  logistics  assessment. 

(k)  Select  from  section  4-4  the  equations,  applicable  criteria, 
and  ground  rules  for  parameter  evaluations. 

(l)  Review  section  4-5  for  applicability  of  the  listed  data  systems 
for  performing  parameter  calculations. 

(m)  Identify  those  calculations  to  be  performed  by  the  data  sys- 
tems and  those  to  be  performed  manually. 

(n)  Determine  which  parameters  can  be  expressed  as  point 
estimates  and  which  must  be  expressed  with  confidence  intervals. 

(o)  Stipulate  from  subsection  4-4e  the  statistical  procedure  for 
developing  confidence  intervals. 

(p)  During  the  program  documentation  review,  qualitative 
logistics  parameters  should  also  be  Identified.  Section  4-6  provides  guidance 
in  this  regard.  During  the  preparation  of  the  LAP,  the  actions  to  be  accom- 
plished include: 

1^.  Define  each  qualitative  parameter  and  establish  relative 
measures  of  effectiveness. 

2.  Prepare  a comprehensive  series  of  questions  concerning 
each  qualitative  parameter.  (These  parameters  may  become  subobjectives  of 
the  LAP,  or  more  often  will  be  considered  factors  listed  under  the  methodolopcy 
portion  of  a subobjective  describing  a measure  of  effectiveness  to  be  evaluated 
by  the  data  reduction  and  analysis  procedures  for  that  subobjective.) 

jl.  Develop  evaluation  sheets,  forms,  or  questionnaires  for 
each  qualitative  parameter. 

4.  Prepare  supplemental  Instructions  (if  required)  for  the 
completion  and  analysis  of  each  evaluation  sheet. 

(3)  Reporting  for  a specific  OT&E  effort  will  be  Influenced  by  the  end 
Item  under  test,  the  magnitude  of  the  program,  the  military  need  for  the  end 
Item,  the  Intensity  of  Congressional  and  DoD  scrutiny,  and  other  significant 
factors.  The  OT&E  plan  will  delineate  the  reports  and  briefings  to  be  generated 
as  a result  of  performing  all  tests.  The  details  of  the  logistics  assessment 
effort  will  usually  comprise  an  annex  to  the  final  report.  Test  reporting  require- 
ments and  formats  are  delineated  In  AFTEC  Regulation  55-1. 
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2-3.  DOCUMENT  APPLICATIONS. 


a.  This  document  was  developed  as  a support  tool  for  OT&E.  However, 
its  uses  are  not  limited  to  that  particular  activity.  Early  in  a system  develop- 
ment program,  AFTEC  should  be  providing  inputs  to  the  Decision  Coordinating 
Paper  (DCP),  Program  Management  Plan  (PMP),  and  Test  and  Evaluation 
Master  Plan.  These  early  documents  have  considerable  impact  throughout  the 
life  of  the  system.  Much  of  the  information  In  this  document  can  be  applied  at 
any  point  in  a program.  Typical  applications  include: 

(1)  Identifying  and  defining  logistics  performance  factors  and 
parameters  for  inclusion  in  program  documentation. 

(2)  Developing  the  logistics  assessment  appendix  for  the  OT&E  plan. 
Including  the  methodology,  data  requirements,  and  data  processing/analysis  and 
evaluation  portions  in  support  of  each  objective/subobjective  contained  in  the  LAl 

(3)  Developing  the  data  collection,  reduction,  and  analysis  appendix 
for  logistics  performance  factors  in  the  OT&E  plan. 

(4)  Identifying  parameters  and  equations  associated  with  selected 
Air  Force  data  systems. 

(5)  Establishing  data  element  requirements  and  parameter  calcula- 
tion procedures. 

(fi)  Preparing  data  element  collection  procedures. 

(7)  Performing  manual  data  analyses. 

(8)  Performing  qualitative  evaluations. 

(9)  Applying  configuration  management  techniques. 

(10)  Applying  statistical  techniques. 

(11)  Preparing  interim  and  final  reports. 

Basic  information  to  support  the  iibove  uses  is  presented  herein. 
However,  specific  instructions  are  provided  only  for  selected  applications. 

b.  AFTEC  involvement  in  a major  Air  Force  system  begins  with  the 
preparation  of  the  OT&E  portion  of  the  initial  Decision  Coordinating  Paper  (DCP) 
Involvement  In  a nonmajor  system  usually  starts  with  the  preparation  of  a Pro- 
gram Memorandum  (PM).  Both  the  DCP  and  the  PM  serve  as  advocacy  and 
direction  documents  in  the  management  of  the  system  development  program. 
Major  and  designated  nonmajor  system  programs  arc  assigned  to  AFTEC  for 
OT&E  management.  Other  nonmajor  programs  are  usually  assigned  to  the 
MAJCOMs  for  OT&E  management  and  monitored  by  AFTEC.  All  major  system 
development  programs  and  designated  nonmajov  programs  receive  the  complete 
attention  of  the  Defense  Systems  Acquisition  Review  Council  (DSAUC). 


c.  The  four  phases  In  the  acquisition  of  a major  system  are  the 
conceptual,  validation,  development,  and  production.  The  decision  to  imple- 
ment the  succeeding  phase  is  made  at  the  completion  of  the  preceding  phase. 

The  types  of  efforts  that  AFTEC  may  perform  during  these  phases  Include: 

(1)  Conceptual  Phase  - lOT&E  objectives  planning  and  test  manage- 
ment planning  as  inputs  to  the  DCP  and  DSARC  1 briefing. 

(2)  Validation  Phase  - Development  of  Test  and  Evaluation  Objectives 
Annex  (TEOA),  test  management  planning,  lOT&E  test  planning,  conduct  of 
lOT&E,  preparation  of  lOT&E  reports,  and  preparation  of  inputs  to  the  DSARC  2 
briefing. 


(3)  Development  Phase  - Review  and  updating  lOT&E  requirements, 
updating  of  lOT&E  test  plan,  conduct  of  lOT&E,  preparation  of  lOT&E  reports, 
and  preparation  of  inputs  to  DSARC  3 briefing. 

(4)  Production  Phase  - Development  of  Follow-on  Operational  Test 
and  Evaluation  (FOT&E)  requirements,  test  management  planning,  FOT&E  test 
planning,  conduct  of  FOT&E,  and  preparation  of  FOT&E  reports.  FOT&E  may 
continue  through  the  deployment  phase  of  the  life  cycle. 

d.  The  information  presented  herein  is  applicable  to  all  of  the  above- 
mentioned  phases  during  the  planning,  conduct,  and  reporting  of  AFTEC 
logistics  assessment  activities. 

e.  The  utility  of  this  document  is  not  constrained  to  AFTEC  logistics 
personnel.  Other  Air  Force  organizations  may  find  it  useful.  The  sections 
covering  data  elements,  data  systems,  qualitative  analysis,  definitions,  etc. , 
make  it  a ready  reference  that  may  have  applications  to  the  planning  and  per- 
formance of  other  efforts.  It  also  provides  a basis  for  a common  understanding 
of  AFTEC's  logistics  assessment  approach. 

2-3.  LIMITATIONS  OF  THIS  DOCUMENT. 

a.  Provided  herein  are  guidance  and  procedures  for  the  general  planning, 
conduct,  and  reporting  of  logistics  assessment.  Also  presented  is  a selection  of 
reference  documents  and  supplemental  information  that  will  aid  in  the  overall 
logistics  assessment  process.  The  uniqueness  of  each  test  program  precluded 
the  development  of  universally  applicable  detailed  procedures.  However,  from 
the  information  presented,  detailed  procedures  for  specific  applications  can  be 
generated. 

b.  Limited  discussions  are  presented  on  cost  of  ownership,  software 
assessment,  and  statistics.  Cost  of  ownership  assessment  is  detailed  in  a 
separate  AFTEC  document  and  only  a brief  summary  is  provided  herein.  Cur- 
rently, software  failures  are  treated  similarly  to  hardware  failures  in  that 
maintenance  resources  must  be  expended  to  return  the  end  item  to  an  operational 
condition.  The  assessment  of  software  during  OT&E  requires  the  development 
of  an  approach,  the  establishment  of  techniques,  the  Identification  of  data  ele- 
ments, and  the  preparation  of  procedures  to  implement  the  approach.  A brief 
discussion  on  statistical  techniques  is  supplemented  by  several  reference  docu- 
ments that  provide  broad  coverage  of  the  subject. 
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CHAPTER  3 


.1 


DOCUMENT  APPLICATION  TO  OT&E 


3-1.  OPERATIONAL  TEST  AND  EVALUATION. 

a.  The  Air  Force  Test  and  Evaluation  Center  was  established  on 

1 January  1974  as  a separate  operating  agency  to  manage  the  Air  Force's 
Operational  Test  and  Evaluation  (OT&E)  Program.  The  concepts  and  policies 
outlined  for  test  and  evaluation  in  Air  Force  Regulation  (AFR)  80-14,  Test  and 
Evaluation,  are  further  defined  by  the  mission  policies  presented  in  AFR  23-30, 
Air  Force  Test  and  Evaluation  Center  (AFTEC),  and  are  implemented  by  the 
procedures  detailed  In  AFTEC  Regulation  55-1,  AFTEC  Operations  Regulation. 

b.  OT&E  is  conducted  to  assess  the  military  utility,  operational  effec- 
tiveness, and  operational  suitability  of  weapon  systems,  and  to  identify  their 
deficiencies.  In  addition,  OT&E  provides  information  on  organization,  per- 
sonnel requirements,  doctrine,  and  tactics;  and  may  provide  data  to  support  or 
verify  material  in  operating  instructions,  publications,  and  handbooks. 

c.  During  OT&E,  the  end  item  is  subjected  to  an  environment  that 
approximates  realistic  operational  conditions  as  closely  as  possible.  Logistics 
factors  of  interest  to  AFTEC  address  those  aspects  of  suitability  comprising 
reliability,  maintainability,  availability,  and  supportabillty.  Accordingly,  the 
logistics  evaluation  must  be  based  on  operational  parameters  that  will  assess  the 
standards  of  acceptability  established  by  using  and  supporting  commands.  Param- 
eters for  logistics  assessment  should  also  be  based  on  limits  of  acceptability 
established  by  these  commands  and  detailed  In  program  documentation. 

3-2.  TEST  CONCEPTS  AND  PHILOSOPHY. 

a.  Life  cycle  cost  (LCC)  has  become  a significant  factor  in  the  acquisition 
of  a system.  Cost  of  ownership  (a  major  LCC  element)  has  been  receiving  par- 
ticular attention  since  it  may  account  for  more  than  half  of  a system's  life  cycle 
cost.  Logistics  factors  that  influence  cost  of  ownership  include  reliability, 
maintainability,  availability,  and  supportabillty.  An  end  item  that  fails  often, 
even  though  easy  to  maintain  and  return  to  an  operationally  ready  state,  may  not 
be  effective  because  of  its  poor  reliability.  An  end  item  that  is  difficult  to 
maintain  will  exhibit  poor  availability  characteristics.  An  end  item  that  is 
awaiting  repairs  due  to  shortages  of  parts,  support  equipment,  technical  data  or 
manpower  may  Indicate  supportabillty  problems.  The  correction  of  these 
problem  areas  requires  the  expenditure  of  resources  that  directly  affect  cost  of 
ownership.  OT&E  is  the  first  phase  in  a system's  life  cycle  where  these 
logistics  factors  can  be  evaluated  under  an  operational  or  near  operational 
environment.  The  closer  these  conditions  can  be  made  to  approach  the  "real 
world",  the  more  accurate  and  valid  a carefully  planned  and  executed  assess- 
ment will  become.  These  evaluations,  and  their  impact  on  future  program 
decisions,  are  of  great  significance  to  the  system  under  development. 
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b.  The  basis  for  the  performance  of  any  test  proKram  is  to  obtain  an 
evaluation  of  end  item  operational  characteristics  with  respect  to  specific  cri- 
teria generated  when  the  need  for  that  end  item  was  established.  The  test  plan 
Is  the  vehicle  that  translates  a test  concept  into  an  organized  approach  for 
accomplishing  a specific  set  of  objectives  within  imposed  constraints  of  time 
and  resources.  The  size  and  complexity  of  a test  program  is  determined  by  the 
nature  of  the  system  to  be  tested  and  the  type  of  testing  to  be  accomplished. 
OT&E  of  a major  weapon  system  may  require  many  separate  tests,  and  the 
associated  plan  may  be  voluminous;  while  other  testing  may  be  well  defined  by  a 
brief  plan.  This  statement  also  applies  to  logistics  testing  and  assessment. 

c.  Critical  questions  to  be  answered  and  areas  of  risk  to  be  evaluated 
are  usually  stated  in  the  Decision  Coordinating  Paper  (DCPj  or  the  Program 
Management  Directive  (PMD).  These  documents,  along  with  the  performance 
criteria,  comprise  the  framework  for  developing  the  (vr&K  jilan.  The  Logistics 
Assessment  Plan  (LAP)  is  an  integral  part  of  the  overall  test  plan.  The  LAP 
must  address  the  objectives  of  logistics  assessment,  delineate  the  specific 
logistics  factors  to  be  evaluated,  present  definitions  and  criteria,  establish  data 
requirements  and  methods  of  collection,  specify  data  analysis  and  reduction 
techniques,  provide  computational  procedures,  detail  test  limitations,  stipulate 
deviations  from  standard  data  systems,  and  discuss  reporting  requirements.  In 
developing  the  LAP,  the  following  principles  should  be  applied: 

(1)  Identify  specific  test  objectives.  The  objectives  should  address 
and  provide  answers  to  the  critical  questions.  Issues,  and  risk  areas  defined  in 
the  procurement  documentation,  and  should  contribute  to  the  overall  evaluation 
of  the  end  item. 

(2)  Utilize  clear  difinitions,  criteria,  and  procedures.  Erroneous 
conclusions  based  on  different  interpretations  of  test  results  can  be  avoided  by 
specifying  these  items  for  each  test  plan.  Everyone  is  then  using  the  same  set 
of  ground  rules. 

(3)  Assure  that  the  tests  have  meaning.  Some  measure  of  merit 
should  be  expressed  by  the  using  command  for  each  significant  parameter  to 
serve  as  a basis  for  determining  the  adequacy  of  test  results. 

(4)  Economize  the  effort.  Utilize  existing  data  systems  when  they 
satisfy  assessment  criteria.  Whenever  possible,  simplify  data  requirements  and 
use  existing  data  forms  and  recording  procedures. 

(5)  Utilize  mutually  supportive  data  collection  efforts.  Increased 
sample  size  may  be  obtained  for  lOT&E  efforts  through  the  selective  use  of 
Development  Test  and  Evaluation  (DT&E)  data.  However,  extreme  caution  must 
be  exercised  in  the  use  of  DT&'E  data.  Definitions,  data  reduction  and  analysis 
techniques,  criteria  and  ground  rules,  etc.,  may  differ  significantly  between 
these  two  test  phases.  Existing  differences  must  lx>  identified  before  any  com- 
bining of  data  is  attempted. 


(fi>  llclate  assessment  efforts  to  the  financial  matinltude  of  the 
production  decision.  The  Importance  of  a decision  should  dictate  the  amount  of 
Information  needed.  A balance  must  be  achieved  between  the  cost  of  Information 
leading  to  a decision  and  the  t'ommltment  resulting  from  that  decision.  As  the 
cost  of  the  decision  increases,  so  should  the  expenditure  of  test  resources. 

(7)  Minimize  the  number  of  test  program  limitations  Imposed. 

(a)  Hurlng  each  test,  make  as  many  observations  and  exercise 
as  much  hardware  as  possible.  Schedule  the  early  participation  of  using  com- 
mand operations  and  maintenance  personnel.  Kxert  pressure  to  obtain  early 
ti'ainlng,  delivery  of  technical  data,  delivery  of  support  equipment,  and  blue- 
suit  hands-on  maintenance  at  both  the  organizational  and  Intermediate  level. 

(bl  Maintainability  demonstrations  must  be  performed  by  trained 
Air  Force  personnel  utilizing  verified  (lAW  TO  OO-S-l)  technical  data  prior  to 
the  production  decision.  Technical  data  should  be  verified  In  time  to  permit 
completion  of  maintainability  demonstrations  prior  to  DSAHC  111.  On  the  other 
hand,  the  technical  data  should  not  be  verified  bx)  early,  since  the  latest  system 
and  equipment  configurations  might  not  be  available  for  the  verification  effort. 
Due  to  constraints  on  system  and  equipment  av’allablllty,  time  phasing  of 
technical  data  verifications  and  maintainability  demonstrations  must  be  care- 
fully scheduled.  However,  planning  must  be  flexible  enough  to  accommodate 
systems,  equipments,  technical  data,  and  personnel  availability.  In  addition, 
Air  Force  personnel  must  be  trained  for  the  appropriate  systems,  equipment, 
and  technical  data  prior  to  the  verifications  and  demonstrations. 

(8)  Consider  the  source  of  test  data.  Biases  may  occur  for  many 
reasons  In  the  documentation  of  data.  Data  reduction  and  analysis  effort  should 
consider  the  personnel  Involved  and  the  circumstances  surrounding  the  liata 
collection  activities.  Wliere  possible,  built-in  checks  and  biilances  should  be 
Imposed  to  limit  data  distortions. 

(9)  Assure  that  test  results  are  comparable.  From  the  earliest 
OT&E  efforts  through  FOT&E,  the  procedures  for  collecting,  analyzing,  and 
reporting  test  results  should  remain  the  same.  The  effects  of  different  end  item 
configurations,  changes  In  operating  and  maintenance  personnel,  training,  etc., 
must  be  tracked.  Comparisons  should  be  made  of  test  results  before  and  after 
the  changes  occurred,  and  the  impact  of  these  changes  should  bo  assessed. 


3-3.  TEST  DESIGN. 


a.  A format  for  the  development  and  preparation  of  test  plans,  annexes, 
and  appendixes  Is  presented  In  chapter  4 of  AFTEC  Regulation  55-1,  and  the 
requirements  for  and  general  contents  of  the  Logistics  Assessment  Plan  (LAP) 
are  discussed  In  chapter  12  of  that  regulation.  In  general,  each  test  plan  will  be 
designed  to  answer  a set  of  critical  questions  and  Issues  that  have  been  trans- 
lated Into  objectives  to  be  addressed  by  OT&F  testing.  These  questions/lssues/ 
objectives  will  have  originated  In  various  program  documentation  (DCP,  PMD, 
PMP,  etc.).  The  test  design  process  results  In  the  development  of  a plan  for 
testing  and  answering  these  objectives,  which  may  be  supplemented,  modified. 
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or  sometimes  even  deleted  as  test  plannlnR  proceeds.  To  assist  In  developing  a 
test  design,  the  following  set  of  logistics  objectives  is  provided  as  a general 
guideline  for  planning. 

(1)  Objectives. 

(al  Test  the  reliability  of  the  weapon  system  to  include  calcula- 
ti<ins  of  mean  time  between  failures  (MTBl').  mean  time  Ix'tween  maintenance 
actions  (MTBM).  moan  time  between  removals  (M  rBltl,  anil  ojx'rational 
reliability. 

(bi  rest  the  maintainability  of  the  weapon  system. 

Test  the  quantitative  maintainability  factors  of  the 
weapon  system  to  include  calcvdatlons  of  maintenance  man-hours  per  flying 
hour/operating  hour/sortie  {MM  KM);  mean  man-hours  to  repair  (MMTlM; 
turnaround  time;  percent  of  scheduled  versus  unscheduled  maintenance  actions; 
percent  corrective  maintenance  actions  versus  support  general  maintenance 
actions;  preventive  maintenance  actions  versus  product  impi’ovement  mainte- 
nance actions;  average  discrepancies  per  inspection,  by  t>qn'  of  inspection; 
quick  turnaround  time;  could  luH  duplicate  (CNDl  rate;  and  bench-checked 
serviceable  rate. 

2.  Test  the  qualitative  maintainability  factors  of  the  weapon 
system  to  Include  evaluations  of  accessibility,  serviceability,  and  ease  or 
difficulty  of  maintenance  of  its  systems,  subsystems,  and  components. 

(c)  Test  the  availability  of  the  weapon  system.  Measure 
operationally  ready  rate  of  the  weapon  system  anti  identify  the  major  factors 
contributing  to  the  nonoperationally  rea(i>’  conditions. 

(dj  Test  the  logistics  supyxirtablUty  of  the  weapon  system. 

Test  the  adt'quacy,  suitability,  completeness,  and 
correctness  of  technical  data. 

2.  Test  transportation  and  handling  equipment  and  con- 
tainers for  suitability  and  compatibility  with  the  weapon  system,  its  components, 
and  support  equipment. 

3.  Test  the  adequacy  of  additional,  new,  or  unique  require- 
ments for  or  modifications  of  facilities. 

4^.  Test  the  adequacy  of  maintenance  training,  and  refine 
determinations  of  training  requirements  to  Include  training  equipment,  media, 
and  facilities,  (ft  is  permissible  to  list  this  subobjective  as  a separate  objective 
and  not  include  it  under  logistics  aupportablllt>’.> 

ii.  Test  the  adt'quacy  of  supply  support  and  associated 

requirements. 


.1-1 


1 


fi.  Tost  tho  atlt'quacy  of  maintenance  personnel 
requirements  for  supportlnR  and  malntnlnlnR  the  weapon  system. 

7.  Test  the  sultnblllt>'  of  orRanlzatlonal  and  Intermediate 
level  ground  support  equipment  ((ISKl. 

(e)  Test  the  adequacy  of  maintenance  training,  and  refine  deter- 
minations of  training  requirements  to  include  training  equipment,  media,  and 
facilities,  (This  element  may  be  included  under  logistics  suppt)rtabilitv  and  not 
as  a separate  item.) 

(ft  Assess  cost  of  ownership  characteristics. 

(2>  Procedures.  The  test  plaiuilng  process  must  develop  the  pro- 
cedures to  bo  used  to  answer  each  objective Asubobjectlve.  These  procedures 
will  Include: 

(a)  Method 

(bl  Data  requirements 

(c)  Data  processing/analysis 

(d)  Kvaluatlon. 

The  above  four  procedural  functions  must  be  planned  In  detail  during  the  test 
design  to  develop  a comprehensive  and  workable  test  plan  to  satisfy  the  various 
logistics  objectives. 

b.  Before  procedures  can  be  prepared  In  support  o(  the  I.AP,  detailed 
consideration  must  be  given  to  the  design  of  the  tests  to  U'  performed. 

Answers  should  be  obtained  to  various  questions,  such  as: 

(1)  How  many  observations  of  each  data  element  are  required  ’ 

(2l  How  many  times  should  the  test  be  repeated” 

(H)  What  factois  of  the  test  should  be  controlled” 

(4)  Can  the  number  of  test  variables  be  reduced” 

(5j  WTiat  data  collection  techniques  should  lx*  Implemented” 

(fi)  Should  statistical  techniques  be  applied  to  data  reduction  and 
analysis,  and  what  should  they  be? 

(7)  WTvat  maintenance  data  collection  system(sl  are  available” 

(5)  What  forms  are  available? 

(91  What  contractor  data  will  be  available  and  how  valid  will  It  Ix'” 


c.  Answers  to  the  atxne  and  other  significant  questions  will  support  the 
test  design.  That  design  Is  a structured  approach  for  the  comiuct  of  an  experi- 
ment and  the  evaluation  of  resulting  data.  The  ay»proach  characterizes  the  test 
and  provides  much  of  the  Information  necessary  for  Its  conduct.  Flements  of 
test  design  include  the  faotoi-s  that  may  Influence  the  outcome  of  the  test.  These 
elements  comprise  such  Items  as  the  measurements  to  Ix^  taken,  their  sequence, 
the  method  by  which  they  are  to  Iw  taken,  and  the  form  and  format  for  their 
I'ecordlng.  Kach  end  item  usually  exhibits  unique  characteristics  that  preclude 
the  development  of  a detailed  universal  approach  to  test  design.  I'he  following 
discussion  provUies  an  overview  of  the  test  design  process. 

(11  From  a review  of  the  critical  questions  and  Issues  to  be  evaluated, 
a set  of  major  test  objectives  is  derived.  Usually  these  objectives  are  of  a 
general  nature  and  are  often  liifflcult  to  evaluate.  Therefore  they  must  be 
lilvlded  Into  a series  of  sulxvbjectlves,  and  In  turn  these  subobjectives  further 
divided  until  a set  of  criteria  are  available  that  can  be  assigned  measures  of 
effectiveness  and  evaluated  by  finite  and  collectable  data.  For  logistics  assess- 
ment, some  of  these  efforts  may  have  alreavly  Iveen  performed  through  the 
establishment  of  measures  of  merit  for  reliability,  maintainability,  availability, 
and  supportablllty  factors. 

(21  The  test  design  Identifies  the  parameter(sl  to  be  evaluated  and 
outlines  the  conditions  for  test  performance.  The  data  elements  required  to 
evaluate  each  parameter  are  identified.  Statistical  techniques  may  be  utilized  to 
establish  confidence  limits  and  the  number  of  data  element  observations  required 
for  each  parameter.  A balance  must  be  achieved  between  the  degree  of 
certainty  associatc<l  with  the  confidence  limits  and  the  time  and  resources  avail- 
able for  test  performance.  Several  Itei'atlons  may  be  necessary  to  obtain  an 
acceptable  compromise.  I’he  test  design  may  Include  a number  of  parameters, 
and  it  may  be  neeessai’v  to  repeat  the  design  process  several  times  before  all 
parameters  of  Interest  can  Ix'  Identified.  Participation  of  a statistician  In  the 
test  design  process  is  highly  desirable. 

(3l  Once  an  acceptable  test  design  has  been  achieved,  detailed  pro- 
cedures for  conducting  the  tests  should  be  prepared.  These  procedvires  should 
Include,  but  not  be  limited  In  content  to,  paragraphs  that: 

(al  I.ist  objectives  and  detail  the  scope  of  the  tests. 

(bl  Present  the  conditions  under  which  the  tests  are  to  be 

pe  rformed. 

(cl  I'lellneate  data  requirements  and  the  forms  ^formats  for  data 

collection. 

(dl  Identify  the  measurements  associated  with  each  data  element. 

(el  llellneate  applicable  definitions  and  criteria  for  data 
reduction  and  analysis. 

(fl  Stipulate  data  cvalviatlon  ani'.  computational  criteria. 
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d.  By  following  the  above  general  procedures,  the  detailed  planning  will 
be  completed  for  the  conduct  of  the  test.  Results  of  that  testing  will  be  the 
satisfactory  accomplishment  of  the  logistics  objectives,  which  will  In  turn 
answer  the  critical  questions  and  Issues  contained  within  the  program  documen- 
tation. It  can  be  seen  then,  that  by  undertaking  a thorough  and  comprehensive 
logistics  test  design,  the  result  Is  the  development  of  a thorough  and  compre- 
hensive test  plan  — the  test  design  becoming.  In  Its  final  form,  the  test  plan. 
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CHAPTER  4 

LOGISTICS  ASSESSMENT 


4-1.  INTRODUCTION. 

a.  The  level  of  loRistlcs  performance  achieved  for  a system  or  equipment 
can  be  assessed  only  if  appropriate  information  is  available.  The  factors  used  for 
quantifying  logistics  performance  are  reliability,  maintainability,  availability, 
supportability,  and  cost  of  ownership.  For  each  of  these  factors,  one  or  more 
parameters  or  measures  of  effectiveness  are  associated  with  its  evaluation. 
Examples  of  some  of  the  major  parameters  utilized  in  assessing  these  factors  are 
given  in  table  4-la. 


TABLE  4-la.  LOGISTICS  PERFORMANCE  FACTORS  AND  PARAMETERS 


Factor 

Typical  Parameters 

Reliability 

Mean  Time  Between  Failures 

Malfunction  Occurrence  Rates 

Mission  Reliability 

Maintainability 

Mean  Man-Hours  to  Repair 

Maintenance  Man-Hours  per  Flying  Hour 

Mean  Time  Between  Maintenance  Actions 

Not  Operationally  Ready  Maintenance  Rate 

Availability 

Operationally  Ready  Rate 

Item  On-Line  Time/Uptlme 

Mean  Time  Between  Failures 

Mean  Time  to  Repair 

Not  Operationally  Ready  Maintenance  Rate 

Not  Operationally  Ready  Supply  Rate 

Supportability 

Reparable  Repair  Rate 

Requisition  Fill  Rate 

Not  Operationally  Ready  Supply  Rate 

Bench  Check  Serviceable  Rate 

Mean  Time  Between  Demands 

I' 
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b.  The  terminology  appearing  In  this  document  Is  that  currently  In 
general  use.  However,  parameters  and  data  elements  are  explicitly  defined 
herein  so  that  there  will  be  no  misunderstanding  concerning  their  meaning  or 
application.  Brief  discussions  are  given  on  the  topics  of  software,  data  sources, 
configuration  management,  and  cost  of  ownership.  Assessment  of  cost  of 
ownership  Is  covered  in  a separate  AFTEC  document*;  however,  cost-oriented 
data  systems  and  their  data  elements  are  identified  and  summarized  herein. 

c.  This  portion  of  the  document  is  organized  to  present  the  assessment 
criteria  in  a logical  order.  Parameters  of  interest  and  data  elements  are  iden- 
tified; forms  for  the  collection  of  data  elements  are  Illustrated;  data  reduction 
and  analysis  techniques  are  discussed;  data  systems  and  their  utility  in  provid- 
ing assessment  information  are  described;  the  value  of  qualitative  evaluations  is 
presented;  and  test  reporting  requirements  are  detailed. 

4-2.  MEASURES  OF  EFFECTIVENESS. 

a.  Measures  of  effectiveness  are  those  quantitative  and  qualitative 
values  associated  with  the  assessment  of  logistics  parameters,  which  provide 
information  concerning  the  logistics  characteristics  of  systems  and  equipments. 
Measures  of  merit  are  stated  goals,  operational  needs,  criteria,  or  standards 
associated  with  system  or  equipment  requirements.  Measures  of  effectiveness 
express  the  degree  of  attainment  of  the  measures  of  merit.  For  example,  a 
computed  mean  time  between  maintenance  is  a measure  of  effectiveness;  a 
requirement  of  iiO  hours  MTBM  in  a DCP  is  a measure  of  merit. 

b.  During  the  preparation  of  the  logistics  assessment  section  of  a test 
plan,  several  factors  must  bo  considered.  First,  existing  program  documenta- 
tion should  be  reviewed  to  determine  the  critical  issues,  questions  and  test 
objectives  that  impact  on  logistics  assessment;  to  identify  the  measures  of 
merit  required  to  evaluate  logistics  performance;  and  to  establish  the  scope  and 
limitations  imposed  upon  the  test  program.  Next,  the  structure  of  the  logistics 
assessment  efforts  should  be  defined.  Elements  to  be  considei’ed  in  this  effort 
include: 

(1)  The  performance  of  tasks  assigned  to  AFTFC  by  AFR  23-30, 

AFR  80-5,  and  AFR  80-14. 

(2)  The  utility  of  data  and  Its  applicability  to  carry  over  from  lOT&E 
to  operational  deployment  of  the  system. 

(3)  Measures  of  merit,  reflecting  user  requirements,  to  determine 
if  test  results  are  satisfactory. 

(4)  Assessment  efforts  that  relate  to  the  financial  magnitude  of  the 
decisions  to  be  made. 
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(5)  The  applicability  to  the  test  program  of  existing  data  systems, 
forms,  and  collection  procedures. 

(fi)  The  use  of  clear  definitions,  criteria,  and  computational  pro- 
cedures to  assure  common  understanding  of  test  results. 

c.  Finally,  the  qualitative  aspects  of  logistics  assessment  must  be 
addressed.  Opinions  based  on  experience  and  engineering  judgment  will  be 
needed.  The  adequacy  of  training  for  maintenance,  the  efficiency  of  fault  detec- 
tion procedures,  and  accessibility  of  equipment  may  require  subjective 
evaluations. 

d.  The  following  paragraphs  discuss  each  of  the  logistics  factors  pre- 
sented in  table  4-la,  the  major  parameters  associated  with  each  factor,  and  the 
data  elements  necessary  to  establish  values  for  each  parameter.  Since  there  Is 
an  overlap  of  parameters  among  the  logistics  factors,  these  parameters  will  be 
defined  only  the  first  time  they  appear. 

(1)  Reliability. 

Reliability  can  be  expressed  in  a number  of  terms  more  useful  to 
OT&'E  applications  than  the  MIL-STn-721B  definition.  While  these  terms  do  not 
express  reliability  as  the  probability  of  an  event  happening  under  stated  condi- 
tions, they  do  provide  a relative  measure  of  equipment  reliability  characteristics. 

(a)  Parameters. 


Table  4-2a  lists  the  major  parameters  associated  with  the 
assessments  of  operational  or  hardware  reliability. 

1.  MTBF  (which  relates  to  hardware  reliabilltyj  is  an  Indi- 
cator of  the  failure  characteristics  exhibited  by  an  Item's  population  during  Its 
functioning  life.  Miles,  cycles,  events,  or  other  units  of  life  measurement  can 
be  substituted  for  time  in  this  expression.  The  end  result  is  the  identification 
of  a mean  value  with  respect  to  failures  of  the  item  in  question.  The  reciprocal 
of  MTBF  is  failure  rate  (for  the  exponential  dlstiibutlonj. 

2.  Malfunction  occurrence  rates  Indicate  the  design  maturity 
of  the  end  Items,  and  reflect  actual  and/or  potential  equipment  problems.  Most 
malfunctions  can  be  directly  attributed  to  failures.  However,  they  may  also  be 
an  Indication  of  interface  or  Interaction  problems  with  other  equipment.  A mal- 
function does  not  always  mean  that  a failure  has  occurred;  in  many  Instances, 
reported  malfunctions  do  not  result  in  identified  failures.  It  does  mean  that 
manpower  was  utilized  In  attempting  to  isolate  a problem  and  to  find  a reason  for 
the  malfunction  occurrence. 

3^.  Through  an  examination  of  failure  oceurrences  and  when 
they  were  discovered,  an  indication  is  provided  as  to  the  adequacy  and  accuracy 
of  examinations  and  Inspections  of  the  equipment.  If  the  majority  of  failures  are 
found  during  flight,  Inspection  criteria  could  probably  be  Improved  to  detect 
these  problems  prior  to  takeoff.  This  situation  may  also  indicate  that  pi'efllght 
and  postflight  checklists  are  not  adequate.  The  primary  purpose  of  maintenance 
actions  Is  to  keep  aircraft  operationally  ready,  and  any  parameter  that  provides 
an  Indication  of  problem  areas  Is  Important. 
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TABLE  4-2a.  RELIABILITY  PARAMETERS 


1. 

Mean  Time  Botwoon  Failures  (MTHF) 

2. 

Failure  Hate 

3. 

Malfunction  Occurrence  Hates 

a. 

Total  Maintenimce  Actions/1000  Flight  Hours 

i>. 

Aborts/l 000  Flight  Hours 

(1)  Before  Flight 

(2)  In  Flight 

c. 

Total  Ahorts/lOOO  Sorties  Flown 

d. 

Failure  t)ccurrences/l000  Operating  Hours 

4. 

Percent  Failures  l)y  When  Discovered  Code 

a. 

Before  Flight 

1). 

In  Flight 

c. 

Between  Flights 

d. 

During  Inspi'ction 

.I. 

Mission  Heliability 

4.  Mission  reliability  is  a measure  of  an  item’s  capability 
to  perform  the  mission  or  function  for  which  it  was  deslRned.  This  probability 
is  affected  by  the  mission  profile,  which  is  a sequential  and  chronological 
description  of  the  item's  mission.  Three  principal  factors  that  affect  aircraft 
operation  are  altitude,  speed,  and  duration.  These  factors  have  a siRniflcant 
influence  on  hardware  performance  and  maintenance  requirements,  and  there- 
fore affect  the  outcome  of  a mission. 

(b)  Data  Elements. 

A number  of  studies  have  been  conducted  to  evaluate 
existing  Air  Force  data  systems  and  their  products.  The  final  report  of  the 
Joint  AFLC/AFSC  Panel  34*  summarized  the  requirements  for  a single  thread 
data  system  for  R&M  assessments  and  presented  numerous  recommendations. 
Of  significance  were  the  recommendations  to  standardize  terms,  definitions, 

♦AFLC/AFSC.  Reliability  and  Maintainability  Single  Thread  Data  System. 

Vol.  I,  dated  1 June  1971  (Panel  ,14). 
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and  data  elements;  adopt  eommon  analytical  techniques  for  fiata  evaluation;  and 
to  Implement  a slnRle-thread  data  system  (STDS).  Documentation  review 
efforts  have  not  disclosed  the  implementation  status  of  these  recommendations. 
However,  selective  use  has  been  made  of  some  recommended  definitions  and 
data  elements,  as  well  as  those  presented  In  DoD  and  Air  Force  documents  in 
the  preparation  of  this  document.  Table  4-2b  presents  a summary  of  data  ele- 
ments utilized  for  equipment  identification  and  reliability  assessment,  and 
recaps  the  most  widely  used  parameters  calculated  from  these  elements. 

(c)  Definitions. 

The  followinR  definitions  are  applicable  to  reliability 
parameters  and  data  elements. 

2-  Mean  Time  Between  Failures  (MTBF)  - For  a particular 
interval,  the  total  operatinR  life  of  a population  of  a part,  component,  sub- 
assembly,  assembly,  subsystem,  or  system  divided  by  the  total  number  of  fail- 
ures within  the  population  during  the  measurement  interval.  This  definition 
holds  for  operating  time,  flying  time,  sorties,  event,  or  other  measures  of  the 
life  units  to  be  applied  when  the  system  operational  reliability  is  being  evaluated. 
It  is  the  average  operating  interval  between  malfunctions  or  degraded  conditions 
requiring  corrective  maintenance. 

2.  Failure  Hate  — The  number  of  failures  of  an  item  per 
unit  measure  of  life  (cycles,  time,  miles,  events,  etc.,  as  applicable  for  the 
item).  For  equipment  exhibiting  an  exponential  failure  distribution,  this  Is  the 
reciprocal  of  MTBF. 

2.  Malfunction  Occurrence  Hate. 

a.  Total  maintenance  actions/lOOO  flight  hours  are  all 
occurrences  reported  under  all  valid  how  malfunctioned  codes  of  type  1,  2,  and 
R,  and  action  taken  codes  E,  F,  H,  J,  K,  L,  P,  II,  S,  U,  X,  and  Z.  (See 
appendix  4-2A  for  Information  concerning  these  codes.) 

b.  Aborts/lOOO  flight  hours  are  expressed  as  a rate 
based  upon  reported  actions  from  the  "on"  equipment  maintenance  Information. 
They  are  divided  into  ground  and  flight  occurrences. 

Total  aborts/lOOO  sorties  flown  is  expressed  as  a 
rate  based  upon  actions  from  "on"  equipment  maintenance  Information  covering 
when  discovered  codes  A and  C. 

A.  Failure  occurrences/lOOO  operating  hours  is 
expressed  as  a rate  based  on  the  occurrences  reported  against  equipment  that 
operate  over  a time  Interval. 

4.  Percent  Failures  by  When  Discovered  Code  (DOf)fiBRr)27). 

a.  Before-flight  failure  occurrences  arc  accumulated 
for  when  discovered  codes  A and  B as  a fraction  of  total  occurrences,  and  con- 
verted to  a percentage. 
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TABLE  4-2b.  RELIABILITY  DATA  ELEMENTS  AND  PARAMETERS 


1.  REQUIRED  DATA  ELEMENTS 

a. 

Job  Control  Number/Report 

P- 

Part  Number  FI 

Number 

q. 

TIme/Mlles/Cycles/Events  FI 

b. 

Date,  This  Report 

r. 

Work  Unit  Code  (WUC) 

c. 

End  Item  (El)  Identification 

s. 

When  Discovered  Code,  Date  and 

d. 

Serial  Number  El 

Time 

e. 

Possessed  Time  El 

t. 

How  Malfunctioned  Code 

f. 

Tlme/Mlles/Cycles/Events  El 

u. 

Action  Taken  Code 

R. 

Number  of  Landings  El 

V. 

Description  of  Problem 

h. 

Date  of  Mission 

W. 

Corrective  Action  (Maintenance 

1. 

Start  of  Mission  (Time) 

Action  Taken) 

j. 

End  of  Mission  (Time) 

X. 

Piece  Parts  Replaced 

k. 

Mission  Type 

y. 

Manufacturer  Installed  Item  (II) 

1. 

Operating  Mode/Mlssion  Phase 

7.. 

Serial  Number  H 

m. 

Time  In  Each  Mode/Phase 

aa. 

Part  Number  11 

n. 

Manufacturer  Failed  Item  (FI) 

ab. 

Time/Mlles/Cycles/Events  11 

0. 

Serial  Number  FI 

ac. 

Type  Maintenance  Code 

2.  CALCULATED  PARAMETERS 

a.  Primary 

1)  Mean  Time  Between 
Failures  (MTBF) 

Failure  Rates 


b. 


2) 

Secondary 
1) 


Total  Maintenance  Actions/ 
1000  Flight  Hours 

2)  Aborts/1000  Flight  Hours 
a.  Before  Flight 

In  Flight 

3)  Total  Aborts/lOOO  Sorties 
Flown 

4)  Failure  Occurrences/lOOO 
Operating  Hours 


3)  Mission  Reliability 


5)  Percent  Failures  by  When  Dis- 
covered Code 

a.  Before  Flight 

b.  In  Flight 

c.  Between  Flights 

d.  During  Inspection 
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I).  Iii-flijiht  failure  occurrences  arc  accimuilatcd  for 
when  (Uscovered  codes  C and  0 as  a fraction  of  total  occurrences,  and  converted 
to  a porcentaRe. 

e.  Hetween-fllRht  failure  occui  renccs  are  accumulated 
for  when  discovered  codes  E,  E,  Cl,  11,  J,  N,  V,  and  11  as  a fraction  of  total 
occurrences,  and  converted  to  a percentape. 

Durinp-lnspection  failure  occurrences  are  accumu- 
lated for  when  discovered  codes  K,  M,  P,  Q,  It,  T,  U,  \V,  X,  Z,  2,  and  4 as  a 
fraction  of  total  occurrences,  and  converted  to  a percentape.  Note  that  failures 
discovered  durlnp  basic  postflipht,  preflipht,  and  home  station  check  are 
Identified  in  the  between-flipht  catepory. 

f).  Mission  Itellability  — The  percentape  of  attempted 
sorties  flown  without  abortinp, 

fi.  Job  Control  N umber /itepoi’t  Number  - A unique  number 
assipned  and  used  to  control  and  tie  topether  every  related  task  needed  to 
accomplish  a job.  Each  related  set  of  symptoms  which  comprises  a slnplc  task 
or  discrepancy  Is  defined  as  a job.  All  actions  taken  to  make  the  fix  — whether 
on  line  or  at  a base  shop,  or  shipment  to  a major  repair  facility  - are  considered 
part  of  the  job  and  must  carry  the  same  number. 

7.  Date,  This  Report  - Year,  month,  and  day  (may  be 
written  day,  month,  year)  the  report  was  initiated.  This  information  is  used  in 
determinlnp  calendar  time  in  completlnp  the  total  actions  relatlnp  to  a sinple 
job  control  number  (JCN),  i.e.,  all  actions  from  the  line,  base  shop,  and  depot. 

End  Item  (El)  Identification-  An  alphanumeric  desipnator 
that  identifies  an  it^m  as  a specific  type,  model,  and  series,  or  a specific 
mission,  desipn,  and  series.  This  identification  can  be  the  same  as  the  Standard 
Ueportlnp  Desipnator  (SKD)  used  with  data  produets  from  the  Standard  Base 
Supply  System,  UlObO-II. 

9.  Serial  Number  El  — A unique  numbt'r  assipned  to  indi- 
vidual items  wlthlnlin  end-item  identification  scheme. 

10.  Possessed  Time  El  — The  time  interval  that  an  item  is 
specifically  assipned  to  an  operational  orpanizatlon  for  the  accomplishment  of 
assipned  missions. 

11.  Time/Miles/Cycles/Fvents  El  - A record  of  the  operat- 
inp  life  of  a serial-numbered  end  item  in  vmlts  of  time,  miles,  cycles,  events 
(as  applicable  for  the  item)  at  the  time  of  failure  or  maintenance  action. 

12.  Number  of  T,andlncs  El  — A record  of  the  number  of 


landlnps  made  by  a specific  aerospace  vehicle. 

13.  Date  of  Mission  - The  year,  month,  and  day  a plven 
mission  was  started. 


14.  Start  of  Mission  (Time)  - The  clock  time  at  the  start  of 

a given  mission. 

15.  End  of  Mission  fTlme)  — The  clock  time  at  the  end  of  a 

given  mission. 

16.  Mission  Type  - A unique  code  identifier  for  the  type  of 
mission  being  accomplished  when  a malfunction  occurred. 

17.  Operating  Mode/Mission  Phase  - A unique  code  Identify- 
ing the  mode  of  operation  and/or  mission  phase  during  which  the  malfunction 
occurred. 


18.  Time  in  Each  Mode/Phase  - The  time  Intervals  that 
items  operated  In  each  mode  or  phase. 

19.  Manufacturer  Failed  Item  (FI)  - Identification  of  manu- 
facturer by  name  or  code  as  provided  In  the  Federal  Stock  Catalog. 

20.  Serial  Number  FI  — A unique  number  assigned  to  Indi- 
vidual Items  within  a functional  group  that  distinguishes  one  item  within  that 
group  from  another. 


21.  Part  Number  FI  - Manufacturer's  number  assigned  to 
individual  items  of  equipment,  used  in  conjunction  with  manufacturer  and  serial 
number  to  track  a selected  item. 

22.  Time/Miles/Cycles/Events  FI  - A record  of  the  operat- 
ing life  of  a failed  item. 

23.  Work  Unit  Code  (WUC)  - A five-digit  coding  structure 
that  identifies  an  item  on  which  maintenance  is  performed;  usually  assigned  only 
to  repair-cycle  assets. 

24.  When  Discovered  Code,  Data  and  Time  — A unique  code 
designed  to  identify  the  mode  of  operation  or  the  phase  of  maintenance  when  a 
discrepancy  is  detected,  along  with  the  day,  month,  year,  and  clock  time  of  the 
detection. 


25.  How  Malfunctioned  Code  — A code  that  describes  the 
physical  defect  of  an  item  undergoing  maintenance,  as  determined  by  the  person 
performing  the  maintenance.  This  code  is  used  by  AFLC  in  conjunction  with 
action  taken  codes  to  determine  failures.  At  the  base  level,  only  how  mal- 
functioned codes  are  used  to  identify  failed  items. 

26.  Action  Taken  Code  — A code  describing  the  type  of 
maintenance  action  accomplished  or  in  progress. 

27.  Description  of  Problem  - A narrative  description  of  a 
problem,  addressing  what  comprises  the  malfunction. 
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28.  ("orrecttvc  Action  (Maintenance  AcH»n  Taken)  - A 
narrative  description  of  the  maintenance  actions  performed  to  repair  the  failed 
item. 

29.  piece  farts  Replaced  — A listing  of  the  failed  items 
removed  from  and  replaced  in  an  assembly  to  restore  it  to  a functional  condition. 
(’>nlv  part  numlH'red  Itcmfs)  with  a National  Item  Identification  Number  (NflNI 
arc  listed. 

no.  Manufacturer,  Installed  Item  (fl)  - Same  as  item 

:U.  Serial  Number  IT  — Same  as  Item  20. 

92.  I’art  Number  II  - Same  as  Item 

99.  Time/Mlles/Cycles/E vents  (11)  - A record  of  the  operat- 
ing life  of  an  installed  item. 

9t.  Tjye  Maintenance  Code  — A one-character  code  used  to 
identify  the  type  of  work  accomplished,  such  as  scheduled  or  unscheduled 
maintenance. 

(2)  Maintainability. 

Maintainability,  as  with  reliability,  can  be  exi>ressed  in  a variety 
of  terms  that  provide  a useful  measure  of  equipment  maintenance  characteristics. 

(a)  Parameters. 

Table  4-2c  lists  the  major  parameters  applicable  to  main- 
tainability assessment. 

1^.  Maintenance  man-hours  per  flifiht,  sortie  operatlnji  hour, 
or  other  unit  of  life  measurement  provides  an  evaluation  of  the  amount  of  mainte- 
nance required  to  keep  an  item  operationally  ready.  This  quantity  can  be  broken 
down  Into  the  different  levels  at  which  maintenance  is  performed  (organizational, 
intermediate,  depot). 

2.  Mean  time  to  repair  (^fFTll)  provides  an  indication  of  the 
ease  or  difficulty  associated  with  the  performance  of  corrective  maintenance, 
Iteflected  in  Ml'TK  are  such  factors  as  the  accessibility  of  equipment  and  the 
adequacy  of  fault  identification  techniques,  technical  orders,  and  training.  This 
parameter  is  usually  expressed  in  clock  hours.  When  expressed  in  man-hours, 
it  becomes  mean  man-hours  to  repair  (MMTU), 

9.  Mean  time  between  maintenance  (Ml’BM)  is  a measure  of 
how  often  maintenance  is  performed.  This  evaluation  includes  on-equipment 
corrective  actions  only.  The  distribution  of  time  among  corrective  actions  pro- 
vides an  indication  of  equipment  design  features,  and  the  relative  Impact  of 
failures  on  the  performance  of  maintenance. 

4.  Mean  active  downtime  (MADT)  is  an  index  of  the  amount 
of  time  an  equipment  or  item  is  not  operational  because  of  scheduled  and 
unscheduled  maintenance.  This  parameter,  like  MTBM,  is  an  indication  of 
equipment  design  features  and  their  Impact  on  logistics  resources. 

5.  The  Not  Operationally  Ready,  Maintenance-Grounded 
(NORM-G)  rate  poliTts  up  the  efficiency  of  the  overall  maintenance  cycle  in  terms 
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TABLE  4-2c.  MAINTAINABILITY  PAllAMETERS 


1.  Maintenance  Man-Hours  per  FllRht  Hour  (MH/FH) 

a.  On  Equipment 

b.  Off  Equipment  (shop) 

c.  Total  (sum  of  all  maintenance  man-hours) 

2.  Maintenance  Man-Hours  per  Operating  Hour  (MH/OH) 

a.  On  Equipment 

b.  Off  Equipment  (shop) 

c.  Total 

3.  Mean  Man-Hours  to  Repair  (MMTR) 

4.  Mean  Time  to  Repair  (MTTR) 

5.  Mean  Time  Between  Maintenance  (MTBM) 

6.  Mean  Active  Down  Time  (MADT) 

7.  Not  Operationally  Ready,  Maintenance  (NORM)  Rate 

a.  NORM-Grounded  (NORM-G)  Rate 

b.  NORM-Flyable  (NORM-F)  Rate 

8.  Not  Repairable  This  Station  (NRTS)  Rate 

9.  Built-In  Test  Effectiveness 

10.  Actuarial  Life  Expectancy 

11.  Dlscrepancles-per-Inspectlon  Rate 

12.  Percent  Scheduled  Inspection  Man-Hours 
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of  spares,  spares  location,  personnel  and  training;,  support  equipment,  technical 
I documentation,  etc.  This  parameter  also  provides  Insight  concerning  equipment 

design  features  and  their  Impact  on  logistics  resources.  The  Not  Operationally 
■ Ready,  Malntenance-Flyable  (NORM-H  rate  Indicates  a reduced  mission  capa- 

bility because  one  or  more  equipments  are  Inoperative  but  the  aerospace  vehicle 
can  still  be  flown.  This  condition  Is  less  severe  than  NORM-G,  and  allows  for 
some  testing  to  be  performed  with  respect  to  logistics  assessments. 

£.  Not  Repali-able  This  Station  (NRTS)  rate  Is  another  Index 
that  provides  a x'elatlve  measui’e  of  the  off-equlpment  maintenance  concept 
developed  for  the  Items  under  test.  Its  value  as  a parameter  Is  based  on  action 
taken  codes  2,  3,  4,  5,  r>,  and  7,  which  Identify  reasons  for  an  NRTS  action 
other  than  "repair  not  authorized".  Comparisons  are  made  between  planned  and 
actual  NRTS  actions  to  determine  how  well  the  planned  maintenance  approach  Is 
working. 

7.  Built-In  test  (BIT)  effectiveness  Is  a measure  of  how  well 

j the  BIT  hardware  and  software  perform  their  fault  detection  and  Isolation  func- 

j tlons  with  respect  to  malfunctlon/fallure  occurrences.  This  parameter  has  an 

Impact  on  man-hour  requirements,  MTTR,  Ml'BM,  MADT  and  NORM. 

8.  Actuarial  programs  developed  by  the  Air  Force  provide 
a forecast  of  expected  failures  based  on  usage  and  past  failures.  Actuarial  life 

L ' expectancy  Is  based  on  the  theory  that  Items  fall  at  various  rates  with  respect  to 

age.  Once  a failure  pattern  can  be  determined,  actuarial  mathematics  Is  applied 
I to  develop  the  forecast.  The  technique  Is  applicable  to  engines,  aaxlllary  power 

units,  certain  helicopter  components,  and  other  equipment  that  exhibits  a 
relationship  between  usage  and  aging.  Actuarial  life  expectancy  provides  a 
method  of  looking  at  equipment  to  determine  when  removals  should  take  place, 
and  Is  a useful  tool  In  the  development  and  evaluation  of  overhaul  and  replace- 
ment cycles. 

f 

(b)  Data  Elements. 

The  parameters  and  data  elements  associated  with  maintain- 
ability were  extracted  from  DoD  and  Air  Force  documents.  Table  4-2d  sum- 
marizes the  elements  utilized  for  equipment  Identification  and  maintainability 
assessments,  and  presents  the  parameters  that  can  be  calculated  from  these 
elements. 

1 ; (c)  Definitions. 

j The  following  definitions  are  applicable  to  maintainability 

parameters  and  data  elements.  (Definitions  of  parameters  and  elements  com- 
\ •-  mon  to  reliability  are  not  repeated.) 

1.  Maintenance  Man-Hours/Fllght  Hour  — The  amount  of 
direct  maintenance  labor  expended  per  unit  of  time  the  aerospace  vehicle  Is 
flown.  This  parameter  may  include  all  "support  general"  and  "non-support 
general"  man-hours,  or  only  03XXX  and  04XXX  coded  support/non-support 
general  manhours  (see  appendix  4-2A). 
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TABLE  4-2d.  MAINTAINABILITY  DATA  ELEMENTS  AND  PARAMETERS 


1.  REQUIRED  DATA  ELEMENTS 

a.  Job  Control  Number/Report 
Number 

b.  Work  Center 

c.  Date,  This  Report 

d.  Activity  Identification 

e.  End  Item  (El)  Identification 

f.  Serial  Number  El 
R.  Possessed  Time  El 

h.  Time /Mlles/Cycles/E vents  El 

1.  Manufacturer  Failed  Item  (FI) 

j.  Serial  Number  FI 

k.  Part  Number  FI 

l.  Tlme/Mlles/Cycles/Events  FI 

m.  Work  Unit  Code  (WUC) 

n.  When  Discovered  Code, 

Date  and  Time 

o.  How  Malfunctioned  Code 

p.  Action  Taken  Code 

2.  CALCULATED  PAIUVMETEHS 

a.  Primary 

1)  Maintenance  Man-Hours 
Flight  Hour 

2)  Maintenance  Man-Hours/ 
Operating  Hour 

3)  Mean  Time  to  Repair  (MTTR) 

4)  Mean  Man-Hours  to  Repair 
(MMTR) 

5)  Mean  Time  Between 
Maintenance  (MTBM) 

b.  Secondary 

1)  Mean  Active  Downtime 

2)  Not  Operationally  Ready, 
Maintenance-Grounded 
(NORM-G)  Rate 


q.  Description  of  Problem 

r.  Corrective  Action  (Maintenance 
Action  Taken) 

s.  Piece  Parts  Replaced 

t.  Units  Completed 

u.  Manufacturer  installed  Item  (II) 

V.  Serial  Number  H 

w.  Part  Number  II 
X.  Tlme/Mlles/Cycles/Kvents  H 
y.  Air  Force  Specialty  Code  (AFSC) 

7..  Crew  Size  (by  AFSC) 

aa.  Start  Time  (Maintenance) 

ab.  Stop  Time  (Maintenance) 

ac.  Delay  Code  (Maintenance) 

ad.  Support,  General  Maintenance 

ae.  Non-Support,  General  Maintenance 

af.  Type  Maintenance  Code 


b.  Secondary  (Cont) 

3)  Not  Operationally  Ready, 
Maintenance-Flvable 
(NORM-F)  Rate 

4)  Not  Repairable  This  Station, 
(NRTS)  Rate 

5)  Built-In  Test  Effectiveness 

6)  Actuarial  Life  Expectancy 

7)  Discrepancies  per  Scheduled 
Inspection 

8)  Percent  Scheduled  Inspection 
Man-Hours 
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2.  Maintenance  Man-Hours/Operating  Hnur  - The  amount  of 
direct  maintenance  labor  expended  per  unit  of  time  the  equipment  Is  operated. 

3.  \rrTR  - The  total  corrective  maintenance  time  divided 
by  the  total  number  of  corrective  maintenance  occurrences  during  a given  period 
of  time.  This  parameter  Is  expressed  in  clock  hours, 

4.  MMTH  - The  total  corrective  maintenance  man-hours 
divided  by  the  total  number  of  corrective  maintenance  occurrences  during  a 
given  time  period. 

5.  Mean  Time  Between  Maintenance  — The  mean  of  the  dis- 
tribution of  the  time  Intervals  between  maintenance  actions. 

G.  Mean  Active  Downtime  — The  average  clock  hours  between 
sorties  when  an  aerospace  vehicle  Is  not  flying,  or  the  average  clock  hours  that 
an  end  Item  is  not  operating  because  of  scheduled  and  unscheduled  maintenance, 
servicing,  supply,  and  administrative  delays. 

7.  Not  Operationally  Heady,  Maintenance-Grounded 
(NORM-G)  — The  aerospace  vehicle  requires  maintenance  that  must  be  performed 
(scheduled  or  unscheduled)  prior  to  flight.  This  category  includes  the  "look  and 
fix"  phase  of  maintenance  inspection  or  Time  Compliance  Technical  Order 
(TCTO),  as  well  as  after  a prefllght  or  thrufllght  inspection,  home  station 
check,  or  basic  postfllght  Inspection. 

8.  Not  Operationally  Ready,  Malntenance-Flyable 
(NORM-F)  - The  aerospace  vehicle  can  lie  flowi,  but  is  not  capable  of  perform- 
Ing  all  of  Its  command  assigned  missions  due  to  one  or  more  of  Its  command 
designated  systems  or  subsystems  being  Inoperative.  In  addition,  maintenance 
must  either  be  in  progress  or  have  been  deferred  for  reasons  other  than  lack  of 
parts  or  supplies. 

9.  Not  Repairable  This  Station  (NRTS)  — A code  for  off- 
equlpment  actions  that  indicates  reasons  for  not  accomplishing  repairs  at  the 
base-level  maintenance  facility.  From  a maintainability  point  of  view.  It  repre- 
sents maintenance  man-hours  expended  in  determining  disposition  of  the  item 
even  though  repair  was  not  accomplished. 

10.  Built-In  Test  Effectiveness  - The  adequacy  and  accuracy 
exhibited  by  the  BIT  equipment  with  respect  to  detecting  and  isolating  faults. 

11.  Actuarial  Life  Expectancy  — The  operating  (flying)  time 
that  can  be  expected  from  an  Item  before  It  fails,  or  before  It  must  be  removed 
and  overhauled  to  bring  it  back  to  a like-new  condition. 

12.  Discrepancies  per  Scheduled  Inspection  - The  average 
number  of  discrepancies  found  during  preflight,  thrufllght,  basic  postfllght, 
phase,  isochronal,  or  periodic  inspection.  It  does  not  Include  discrepancies 
found  during  special  Inspections  such  as  hard  landing,  saltwater  exposure,  etc. 

13.  Percent  Scheduled  Inspection  Man-Hours  - The  percent- 
age of  total  man-hours  expended  on  scheduled  Inspections,  l.e.,  prefllght, 
thrufllght,  basic  postfllght,  phase,  isochronal. 

14.  Work  Center  — A five  digit  code  that  Identifies  organiza- 
tional elements  to  which  maintenance  personnel  are  assigned,  or  location  to 
which  they  may  be  dispatched. 
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15.  Activity  Identification  — Identification  of  the  base  in 
possession  of  an  Item. 

16.  Units  Completed  — The  number  of  like  items  worked  on 
and  actions  completed  for  a given  WI^C. 

17.  Air  Force  Specialty  Code  (AFSC)  — A unique  identifier 
that  indicates  a person's  area  of  specialization  and  skill  level  associated  with 
that  specialty. 

18.  Crew  Size  (by  AFSC)  — The  number  of  maintenance  per- 
sonnel by  Air  Force  Specialty  Code  performing  a maintenance  action. 

19.  Start  Time  (Maintenance)  - The  actual  clock  time,  to  the 
nearest  5 minutes,  at  which  a maintenance  action  was  Initiated, 

20.  Stop  Time  (Maintenance)  - The  actual  clock  time,  to  the 
nearest  5 minutes,  at  which  a maintenance  action  was  terminated  for  more  than 
15  minutes. 


21.  Delay  Code  — A unique  identifier  indicating  that  a mainte- 
nance task  has  been  delayed  for  some  particular  reason. 

22.  Support,  General  Maintenance  - A coding  structure  that 
Identifies  support-time  maintenance  actions  such  as  servicing.  Inspections, 
tow'lng,  washing,  cleaning,  corrosion  prevention,  handling,  preservation,  and 
depreservation  of  equipment,  preparation  of  records  and  publications,  and  shop 
support  functions.  WUCs  OIXXX  through  09XXX  are  Included  in  this  category. 

23.  Non-Support,  General  Maintenance  - A coding  structure 
that  Identifies  corrective  maintenance  actions  on  specific  WUCs,  as  w'ell  as  all 
other  maintenance  actions  not  classified  as  support  type  actions.  Included  are 
WUCs  IIXXX  through  99XXX. 


(3)  Availability. 


Availability  can  be  expressed  by  a number  of  parameters  related 
directly  and  Indirectly  to  reliability,  maintainability,  and  supportablllty.  These 
parameters  Indicate  the  capability  of  a system  to  support  or  sustain  an  opera- 
tionally ready  rate,  utilization  rate,  or  some  other  expression  related  to 
productivity. 


(al  Parameters. 


availability. 


Table  4-2e  lists  the  major  parameters  associated  with 


U Operationally  ready  rate  Is  an  expression  of  the  avail- 
ability of  an  Item,  and  Includes  standby,  alert,  and  mission  time.  This  param- 
eter reflects  the  fact  that  even  though  an  aerospace  vehicle  is  not  performing  a 
mission.  It  Is  In  a condition  to  respond  if  called  to  do  so  and  be  capable  of 
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TABLE  4-2e.  AVAILABILITY  PARAMETERS 


1.  (Tpo  rationally  Ready  Rate 

2.  Aircraft  Utilization  Rate  (Sortie  Generation  Rate) 

3.  Item  On-Line  (Uptime) 

4.  Item  Standby  Time 
f).  Item  Alert  Time 
G.  Item  Downtime 

a.  Scheduled 

b.  Unscheduled 

c.  Delay 

7.  Mean  Time  Between  Failures  (MTBF) 

8.  Mean  Man-Hours  to  Repair  (MMTR) 

9.  Mean  Time  to  Repair  (MTTR) 

10.  Not  Operationally  Ready,  Maintenance  (NORM)  Rate 

11.  Not  Operationally  Ready,  Supply  (NORS)  Rate 

12.  Mean  Active  Downtime 


performlnR  all  assigned  missions.  Historically,  availability  has  been  expressed 
as  a probability  that  an  item  is  ready  to  operate  at  any  point  in  time  when  used 
under  stated  conditions.  The  operational  readiness  concept  is  that  cither  an  item 
is  operating  satisfactorily  or  is  ready  to  be  placed  in  operation  on  demand  when 
used  under  stated  conditions.  Thus,  operational  readiness  provides  a more  com- 
prehensive evaluation  of  the  status  of  an  item  when  considered  along  with 
utilization  rates. 

2.  Aircraft  utilization  (sortie  generation)  rate  is  an  Indicator 
of  the  average  flying  hours,  or  sorties,  for  a specified  time  period.  This  factor 
is  the  one  most  important  in  developing  the  operationally  ready  rate  because  it 
represents  the  mission  aspects  of  readiness;  it  also  can  be  used  to  evaluate 
sortie  planning  versus  actual  accomplishments.  Stating  or  measuring  an  opera- 
tionally ready  rate  without  considering  the  utilization  rate  has  little  value  and  can 
be  misleading. 

3.  Item  on-line  (uptime)  is  the  time  that  an  end  item  is 
available  to  perform,  or  Is  performing,  its  intended  mission.  This  parameter 
comprises  standby,  alert,  reaction,  and  misrion  time  if  the  end  Item  is  not 
expected  to  operate  continuously  except  for  maintenance  and  supply  downtime. 
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4.  Standby  time  Is  a measure  of  the  time  that  an  item  is 
considered  to  bo  In  an  operatlnK  condition,  but  has  not  been  completely  activated 
to  bring  It  to  an  alert  status. 

r>.  Alert  time  Is  a measure  of  the  time  that  an  Item  la  con- 
sidered to  be  In  an  operating  condition  and  ready  to  perform  Its  specified  mis- 
sion, but  has  not  yet  been  called  upon  to  perform  Its  mission. 

fi.  Oowntlme,  when  compared  with  total  time  (equipment 
hours  per  month),  provides  an  evaluation  of  the  percentage  of  time  an  Item  was 
not  available  for  performing  Its  mission.  Downtime  Is  comviosed  of  scheduled, 
unscheduled,  and  delay  times  associated  with  maintenance  on  the  Item. 

7.  The  MTRF,  Kri'T!!,  MMTU,  and  NOItM  parameters  are 
also  associated  with  reliability  and  maintainability,  and  were  previously 
dlacusse<l. 

The  NDUS-D  rate  Is  an  Indication  of  how  often  the  item  Is 
unavailable  because  parts  required  from  Supply  could  not  be  provided.  This 
parameter  Is  also  associated  with  supportablllty.  NOUS-F  is  a less  severe  con- 
dition than  NOHS-G,  and  allows  for  some  testing  to  be  pt'rformed. 

(b)  Data  Flements. 

Data  elements  associated  with  availability  were  extracted  from 
DoD  and  Air  Force  documents.  Table  4-2f  presents  a summary  of  the  elements 
utlll'/.ed  for  equipment  Identification  and  available  assessments,  and  Indicates 
the  most  widely  used  parameters  calculated  from  these  elements. 

(c)  Definitions. 

The  following  definitions  are  applicable  to  availability 
parameters  and  data  elements.  Previously  defined  parameters  and  elements 
will  not  be  repented. 

Operationally  Heady  Kate  - The  fraction  of  time,  within 
some  specified  calendar  period,  that  an  Item  Is  capable  of  performing  all  of  Its 
assigned  missions. 

2.  Aircraft  Utllly.atlon  (Sortie)  Kate  - The  fraction  of  time/ 
sorties  that  an  Item  la  performing  Its  assigned  missions,  within  some  specified 
calendar  period. 

0.  Item  On-Line  (Uptime)  - The  Interval  of  time  during 
which  an  Item  Is  on  standby,  on  alert,  or  reacting  to  or  performing  a mission. 


Item  Standby  Time  - The  Interval  of  uptime  during  which 
an  Item  la  In  a specified  operable  condition  but  not  fully  activated. 
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TABLE  4-2L  AVAIT.ABILITY  DATA  ELEMENTS  AND  PAIIAMETEI^ 


1.  REQUIRED  DATA  ELEMENTS 

a. 

Job  Control  Number/Report 

r. 

Work  Unit  Code  (WUC) 

Number 

s. 

When  Discovered  Code,  Date  and 

b. 

Work  Center 

Time 

c. 

Date,  This  Report 

t. 

How  Malfunctioned  Code 

d. 

Activity  Identification 

u. 

Action  Taken  Code 

e. 

End  Item  (El)  Identification 

V. 

Description  of  the  Problem 

f. 

Serial  Number  El 

w. 

Corrective  Action  (Maintenance 

B. 

Possessed  Time  El 

Action  Taken) 

h. 

Tlme/Mlles/Cycles/E vents  El 

X. 

Piece  Parts  Replaced 

1. 

Number  of  Landings  El 

y. 

Units  Completed 

j. 

Number  of  Sorties  El 

z. 

Tlme/Mlles/Cycles/E  vents. 

Installed  Item  (II) 

k. 

Date  of  Mission 

aa. 

Air  Force  Specialty  Code  (AFSC) 

1. 

Start  of  Mission  (Time) 

ab. 

Crew  Size  (by  AFSC) 

tn. 

End  of  Mission  (Time) 

ac. 

Start  Time  (Maintenance) 

n. 

Mission  Type 

ad. 

Stop  Time  (Maintenance) 

o. 

Operating  Mode/Mission  Phase 

ae. 

Delay  Code  (Maintenance) 

P. 

Time  in  Each  Mode/Phase 

af. 

Support,  General  Maintenance 

q. 

Tlme/Mlles/Cycles,  Events, 
Failed  Item  (FI) 

ag. 

Non-Support,  General  Maintenance 

ah. 

Type  Maintenance  Code 

2.  CALCULATED  PARAMETERS 

a. 

Primary 

b. 

Secondary  (Cont) 

1)  Operationally  Ready  Rate 

r>)  Mean  Time  to  Repair  (MTTR) 

2)  Aircraft  Utilization  Rate 

7)  Not  Operationally  Ready, 

(Sortie  Rate) 

Maintenance-Grounded 

b. 

Secondary 

(NORM-G)  Rate 

1)  Item  On-Line  (Uptime) 

8)  Not  Operationally  Ready, 

21  Item  Standby  Time 

3)  Item  Alert  Time 

Maintenance -Flyable 
(NORM-F)  Rate 

4)  Item  Downtime 

9)  Not  Operationally  Ready, 
Supply-Grounded  (NORS-G) 

a)  Scheduled 

b)  Unscheduled 

Rate 

c)  Delay 

10)  Not  Operationally  Ready, 

5)  Mean  Time  Between  Fall- 

Supply- Flyable  (NORS-F)  Rate 

ures  (MTBF) 

11)  Mean  Active  Downtime 

I 

I 
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5.  Item  Alert  Time  - The  Interval  of  uptime  diirlnR  which 
iui  Item  Is  In  a specified  operable  condition  awaltlnR  a command  to  perform  Its 
asslpned  missions. 

fi.  Item  Downtime  - The  Interval  of  time  durlnpc  which  an 
item  Is  not  In  a condition  to  perform  Its  assigned  mission.  U comprises 
sclu'duled,  unscheduled,  and  delay  times  associated  with  maintenance  actions, 

NOllS-G  - The  aerospace  vehicle  Is  not  capable  of  flight 
due  to  a verified  lack  of  parts.  This  condition  Is  applicable  only  If  a NOUS 
demand  has  been  placed  on  supply  and  verified  In  accordance  with  standard 
procedures. 

NOIIS-F  - The  aerospace  vehicle  can  be  flown,  but  is  not 
capable  of  performing  all  of  its  Command-assigned  missions  due  to  one  or  more 
of  its  Command-designated  systems  or  subsystems  being  inoperative;  and  parts 
are  required  to  return  it  to  fully  operational  status.  This  condition  must  be 
verified,  as  for  a NOllS-G  designation. 

9.  Number  of  Sorties  El  — The  cumulative  number  of  flights 
of  a single  aerospace  vehicle. 

(4)  Supportabillty. 

Supportablllty  can  be  evaluated  by  a number  of  parameters  that 
measure  the  adequacy  of  the  support  developed  for  a system.  It  Is  basically 
depleted  by  the  relationship  between  the  demand  for  and  the  availability  of 
logistics  resources  for  deplo5Tnent  of  a new  system.  Values  of  parameters 
associated  with  supportablllty  will  not  usually  be  Identified  In  program  documen- 
tation. However,  Information  can  be  obtained  from  similar  systems  in  operation 
to  gain  Insight  as  to  relative  values  of  selected  parameters.  Supportablllty 
assessments  will  require  both  quantitative  and  qualitative  Information. 

(a)  Parameters. 

A list  of  the  major  parameters  is  presented  In  table  4-2g. 

1.  Repair  capability  is  a measure  of  the  number  of  off- 
equlpment  malntenalice  actions  that  can  be  accomplished  at  base  level;  and  repair 
rate  Is  a measure  of  how  many  actions  can  be  performed  In  a given  time.  Bench 
check  serviceable  rates  and  could-not-dupllcate  rates  are  measures  of  how  often 
equipments  are  removed  and  replaced  when  there  appear  to  be  problems,  but 
these  problems  are  not  verifiable  under  detailed  checkout.  Mean  time  between 
demands,  cannibalization  rates,  and  requisition  fill  rates  are  indicative  of  the 
adequacy  of  the  supply  system  In  terms  of  how  often  repair  parts  are  requisi- 
tioned from  supply,  and  to  what  degree  these  requisitions  are  finable  from 
on-hand  stock.  AGE  utilization  rates,  support  equipment,  maintenance  man- 
hours, and  precision  measuring  equipment  (PME)  no-defect  rates  are  all  influ- 
enced by  management  decisions  concerning  the  support-type  equipment  to  be 
used  In  system  maintenance. 

2.  For  the  most  part,  assessment  of  qualitative  parameters 
for  supportablllty  vdll  rely  on  available  Information  concerning  similar  deplove<i 


TABLE  4-2r.  SUPPORTABILITY  PARAMETERS 


1 . Quantitative 

a.  Hepalr  Capability 

b.  Reparable  Repair  Rates 

c.  Bench  Check  Serviceable  Rates 
(1.  Could  not  Duplicate  Rates 

e.  Not  Operationally  Ready,  Supply  (NORS)  Rates 
1.  Mean  Time  Between  Demand  (MTBD) 

g.  Aerospace  Ground  Equipment  (AGE)  Dtlllz;itlon  Rates 

h.  Support  Equipment  Maintenance  Manhours 

1.  Precision  Measuring  Equipment  (PME)  No  Defect  Ratos 

j.  Requisition  Fill  Ratos 

k.  Cannibalization  Rates  (cannlballzatlons  per  sortie) 

2.  Qualitative 

a.  Maintenance  Plan  and  Sup)X)rt  Concept  Adequacy 

b.  Supply  Support  Adequacy 

c.  'rrimsportatlon/llandllng  Adequacy 

d.  Technical  Data  Adequacy 

e.  Test  and  Support  Equipment  Adequacy 

f.  Support  Facilities  Adequacy 

g.  Training  Adequacy 

h.  Initial  and  Replacement  Spares  Adequacy 

i.  Configuration  Management  Adequacy 
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systoms  and  judgments  bised  on  previous  experiences  of  test  team  memhors. 
Gemeral  guidance  concerning  evaluation  of  qualitative  parameters  Is  presented 
In  section  -l-fi. 


(b)  Data  Klements. 

The  data  elements  required  to  Identify  eqidpment  and  calcu- 
late quantitative  supportablllty  parameters  are  the  same  as  those  associated 
with  reliability,  maintainability,  and  availnblllty  parameters,  and  will  not  be 
repeated  In  this  section. 

(c)  |)eflnitions. 

Kepalr  Capability  — The  percentage  of  components 
delivered  to  the  base-level  maintenance  functions  for  repair  that  are  actually 
repaired  (repaired  units  plus  action  taken  codes  2 through  (‘>1. 

2.  Iteparable  Uepalr  Itate  — The  percentage  of  compiments 
assigned  to  base-level  maintenance  for  repair  that  are  actually  rt'palred 
(repaired  units  plus  action  taken  codes  1 through  51). 

d.  ritmch  Check  Serviceable  Hate  — The  percentage  of  iltuns 
removed  from  the  end  Item  for  which  the  suspected  failui'e  was  not  confirmed 
during  bench  check  using  available  skills,  test  equipment,  and  technical  ilata. 

Could  Not  Oupllcatc  Itate  - The  percentage  of  reported 
on-equIpment  malfunctions  chcckc<l  and  found  to  require  no  further  maintenance 
action. 


d.  Mean  Time  Rctween  Uemand  — The  average  operating 
time  between  removal  of  components  for  suspected  failure,  with  failure  con- 
firmed during  bench  check. 

d.  AGK  Ctlll/atlon  Kate  — The  averagi'  houi's  per  month  that 
aerospace  ground  equipment  is  operateil. 

7.  Support  Kqulpment  Maintenance  Man-Hours  per 
Operating  Hour  — The  direct  maintenance  lalx^r  spent  on  maintenance  of  svipport 
equipment  (.\CiE)  per  unit  of  equipment  operating  time. 

S.  rreclslon  Measuring  Kqulpment  (PMF)  No  Hefect 
Rate  - The  percentage  of  instances  that  PMK  arc  found  to  be  (lefect-free  during 
scheduled  calibration,  compared  with  the  total  numlx'r  of  I'Ml's  calibrated  over 
some  time  span. 


0.  Requisition  Fill  Rates  - The  percentage  of  Instances  that 
requisitions  for  components,  modules,  repair  parts,  consumables,  etc.,  are 
filled  by  Iwise  supply  within  prescribed  time  limits,  compared  with  the  total  nuni- 
ber  of  requisitions  presented  to  liase  supply  over  some  finite  time  span  (weeks, 
months,  etc.). 


} 
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10.  Cannibalization  Rate  — A measure  of  the  cannibalization 
actions  performed"^er  sortie  to  keep  end  items  in  an  operationally  ready 
condition. 

11.  Maintenance  Plan  and  Support  Concept  Adequacy  — How 
well  the  maintenance  plan  and  support  concept  fulfill  the  needs  of  an  end  item  to 
sustain  an  operationally  ready  rate. 

12.  Supply  Support  Adequacy  - The  capacity  of  supply  support 
planning  and  implementation  to  sustain  base-level  maintenance  requirements. 

13.  Transportation/Handling  Adequacy  - The  sufficiency  of 
the  planning  and  implementation  factors  associated  with  transportation,  packag- 
ing, and  handling  to  satisfy  end  item  support  requirements. 

14.  Technical  Data  Adequacy  - Adequacy  of  technical  data  to 
support  end  item  maintenance  and  operation. 

15.  Test  and  Support  Equipment  Adequacy  - The  capability  of 
test  and  support  planning  and  equipment  to  sustain  end  item  operations. 

16.  Support  Facilities  Adequacy  - The  capacity  of  available 
support  facilities  to  sustain  end  item  operation. 

17.  Training  Adequacy  — The  sufficiency  of  the  training 
received  or  planned  for  operation,  checkout,  and  maintenance  of  an  end  item. 

18.  Initial  and  Replacement  Spares  Adequacy  - The  sufficiency, 
with  respect  to  sustaining  an  end  item  operationally-ready-rate,  of  planned  and 
implemented  initial  and  replacement  parts  stockage  levels  for  maintenance  and 
repair.  (May  be  considered  an  element  of  Supply  Support,  Item  12.) 

19.  Configuration  Management  Adequacy  - The  adequacy  of 
the  configuration  management  planning  and  the  practices  developed  and  imple- 
mented for  an  end  item. 

(5)  Cost  of  Ownership  Summary. 

(a)  Cost  of  ownership  (COO)  is  defined  as  the  total  cost  of 
operations,  maintenance,  and  support  for  an  end  item  over  the  build-up  period 
plus  a 10-year  operational  period.  COO  excludes  development,  acquisition,  and 
disposal  cost.  Applicable  directives  are  AFR's  23-36,  80-14,  and  800-11, 

(b)  AFTEC  has  published  a Cost  of  Ownership  Handbook  that 
provides  detailed  guidance  for  assessing  the  ownership  cost  of  a variety  of  end 
items.  This  document  delineates  and  defines  cost  elements,  discusses  the  cost 
element  parameters,  lists  cost  data  sources,  and  identifies  equations  for  cost 
element  calculations. 
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(c)  coo  assessments  by  AFTEC  are  designed  to  complement  and 
enhance  the  existing  Air  Force  management  and  cost  estimating  functions.  This 
is  generally  accomplished  by  providing  Information  collected  during  CtT&F  which 
will  permit: 


U defining  the  official  program  operating  and  support  ((US) 

cost  estimates. 


2.  Identifying  system  characteristics  or  deficiencies  which 
significantly  Impact  the  cost  of  ownership. 

(d)  Concerning  the  first  objective  (refinement  of  O&S  costs), 
AFTEC  will  use  the  official  O&S  cost  estimates,  prepared  by  cost  analysis 
offices  and  Independent  cost  analysis  (ICA)  teams,  as  the  basis  for  obtaining  and 
providing  Information.  During  OT&E,  AFTEC  will  endeavor  to  acquire  test 
information  that  might  bring  the  cost  estimates  more  In  line  with  future  opera- 
tional experience  via  analysis  of  test  sensitive  elements  outlined  Ix'low.  The 
O&S  cost  estimates  referred  to  are  based  principally  upon  methodology  of  the 
Air  Force  Cost  Analysis  Cost  Estimating  (CACE)  model,  which  is  descrllxvi  in 
the  CAIG  Cost  Development  Guide,  May  1974.  Similar  guides  are  being  devel- 
oped for  non-aircraft  systems.  The  elements  of  these  estimates  where  AFTEC 
can  provide  greatest  assistance  are: 

1,.  Base  aircraft  maintenance  manpower 

2.  Base  munitions  maintenance  manpower 

3.  Aviation  POL 

4.  Base  aircraft  maintenance  material 

3.  lieplenishment  spares 

G.  Common  support  equipment. 

(e)  These  will  be  areas  of  principal  concentration.  In  addition, 
assessments  of  maintenance  manpower  costs  will  focus  on  results  obtained  by 
the  Logistics  Composite  (LCOM>  model,  or  other  manpower  determination 
methods.  Assessments  will  project  rcqulrements/costs  for  the  time  periods  of 
Initial  equlppage  and  for  mature  systems.  To  assist  In  meeting  the  objective  of 
O&S  cost  refinement  the  following  will  apply: 

1.  Program  offices  plus  AFSC  and  AFT.C  comptroller  cost 
analysis  offices  will  furnish  AFTEC  with  O&S  cost  estimates  for  these  systems 
In,  or  scheduled  for,  OT&E  Including  supporting  rationale  for  each  cost  element. 

2.  AF/ACM  will  furnish  AFTEC  with  (')«.R  cost  estimates 
for  each  new  system  as  the  estimates  are  developed  and  refined.  The  Informa- 
tion provided  will  Include  adequate  detail  on  the  methodology’  and  assumptions  to 
permit  AFTEC  construction  of  cost  elements. 
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3.  In  the  interests  of  standardization,  the  cost  analysis 
offices  and  Independent  cost  analysis  teams  will  Include  those  O&S  cost  elements 
described  in  the  CAIG  Cost  Development  Guide  as  a part  of  their  life  cycle  cost 
estimates.  The  use  of  these  elements  allows  for  a consistent  approach  to 
assessments  and  further  permits  test  planners  to  structure  data  collection 
efforts  to  ensure  that  correct  data  is  collected  during 

4.  AFTEC  will  provide  information  to  AF/ACM,  AF/PRM, 
AFSC  and  AFLC  to  use  in  refining  estimates  and  performing  independent  cost 
analyses,  including  information  on  significant  cost  that  may  not  have  been 
included  in  the  estimates,  if  any  become  apparent. 

(0  Concerning  the  second  objective  (identifying  system  character- 
istics), AFTEC  will  endeavor  to  obtain  and  provide  information  to  the  imple- 
menting, supporting  and  using  commands  which  will  assist  them  in  quantifying 
and  evaluating  relative  O&S  cost  impacts  attendant  to  specific  equipment 
characteristics  or  deficiencies.  Normally,  this  information  will  be  similar  to 
reliability  and  maintainability  parameters  already  needed  to  evaluate  operational 
suitability  of  the  system.  To  enable  AFTEC  to  satisfy  this  objective  the  imple- 
menting, supporting,  and  using  commands  will  furnish  AFTEC  adequate  infor- 
mation concerning  the  O&S  cost  estimating  models  and  techniques  to  lx*  used  by 
them  during  the  program,  and  specific  Information  requirements  and  O&S  cost 
baselines,  before  OT&F  begins.  In  the  absence  of  this  information,  AFTEC 
will  assume  use  of  the  AFLC  logistics  support  cost  model  and  obtain  data  to 
utilize  this  model  for  principal  elements  of  the  system.  If  it  is  useful  to  cite 
relative  O&S  cost  impacts  associated  with  a particular  element  of  the  system  to 
establish  deficiency,  these  costs  will  be  reflected  in  formal  evaluation  reports. 
However,  the  principal  emphasis  will  be  upon  providing  information  to  agencies 
for  cost  of  ownership  estimates.  Participating  commands  in  OT&F  will  assist 
AFTEC  in  accomplishing  the  cost  of  ownership  objectives, 

(6)  Software  and  Measures  of  Effectiveness. 

(a)  Software  performance  has  a significant  impact  on  the  results 
of  a test  and  evaluation  project.  Current  data  systems  provide  a limited 
capability  for  reporting  and  evaluating  software.  Although  some  how  malfunc- 
tioned codes  have  been  established  for  computers  and  software,  the  work  unit 
codes  and  action  taken  codes  are  hardware  oriented.  It  is  possible  to  obtain  a 
data  sort  on  these  how  malfunctioned  codes,  but  there  is  no  way  of  determining 
whether  hardware  or  software  caused  the  problem.  For  example,  during  Ix'nch 
check  of  a computer  the  components  are  replaced  and  software  is  reloaded.  A 
component  failure  could  have  erased  or  changed  the  computer  program,  or  a 
faulty  program  could  hav’e  overloaded  one  or  more  electronic  parts.  Even  if 
the  technician  can  determine  the  cause,  he  has  no  way  of  adequately  coding  his 
findings.  In  all  probability  it  will  be  listed  as  a hai-dware  problem.  On  AFTO 
form  349  he  can  suiiplcment  the  coding  system  with  a narrative  description  of 
what  was  found  and  what  was  done  to  make  the  repairs.  To  perform  any  t.\pe  of 
software  evaluation  would  require  a visual  review  of  each  form  associated 
with  computer  maintenance,  and  a manual  scorekeeping  etfort  of  those  failures 
attributed  to  software. 
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(b)  Both  hardware  and  software  failures  Impact  on  all  logistics 
parameters.  One  of  the  primary  objectives  of  a test  and  evaluation  effort  is  to 
assess  these  parameters  under  actual  operating  conditions.  It  Is  desirable  to 
evaluate  software  separately  from  hardware.  However,  techniques  and  specific 
data  requirements  must  be  developed  to  perform  software  evaluations  In  an 
OT&E  environment.  Until  these  techniques  are  available,  hardware  and  soft- 
ware failures  should  be  treated  In  a similar  manner.  Both  should  be  Included  In 
the  calculations  of  parameters  for  overall  end  Item  assessment.  This  approach 
does  not  provide  for  a separate  software  assessment  but  does  Include  the  Impact 
of  software  on  end  Item  performance  during  OT&E. 
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4-3.  DATA  COLLECTION. 

a.  The  importance  of  the  data  collection  task  for  loKistics  assessment 
cannot  be  overemphasized.  Both  the  quantity  and  quality  of  the  information 
impacts  on  the  results  obtained  from  the  test  effort.  Air  Force-developed  forms 
and  collection  procedures  appear  to  be  adequate  for  the  majority  of  data  ele- 
ments needed  for  logistics  evaluations.  However,  some  selected  cases  may 
require  adaptation  or  modification  of  these  forms  and  procedures. 

b.  This  section  addresses  obtaining  the  data  elements  defined  in  sec- 
tion 4-2.  A number  of  data  forms  available  for  logistics  evaluations  are  illus- 
trated, their  applicability  to  different  hardware  types  is  discussed,  and 
guidance  documentation  for  the  use  and  preparation  of  these  forms  is  referenced. 
Data  elements  available  from  selected  forms  are  identified,  as  well  as  data 
sources  available  for  comparison  purposes. 

(1)  Data  Forms. 

Within  the  Air  Force  are  numerous  forms  for  recording  and 
documenting  data  and  information.  A review  of  many  of  these  forms  indicates 
that  they  fall  into  two  general  categories;  those  providing  primary  data  with 
respect  to  harcKvare  assessment,  and  those  providing  supplemental  information 
concerning  hardware,  technical  data,  and  personnel.  In  many  cases  informa- 
tion is  contained  on  both  sides  of  a form.  Some  examples  of  forms  provided  in 
this  section  show  only  the  front  side  to  identify  that  specific  form.  However, 
where  significant  information  is  documented  on  the  reverse  side,  both  sides 
are  shown.  The  technical  orders  and  manuals  that  contain  reporting  instruc- 
tions indicate  whether  they  are  one-  or  two-sided  forms.  Table  4-3a  presents 
a matrix  of  primary  forms  and  their  applicability  to  various  hardware  types. 

The  following  paragraphs  discuss  each  of  the  forms  listed  in  that  table. 

(a)  AFTO  Form  349  — Maintenance  Data  Collection  Record. 

(Figure  4-3a) 

This  form  is  the  Air  Force's  universal  source  of  mainte- 
nance data  for  all  types  of  hardware.  It  is  limited  with  respect  to  providing 
logistics  assessment  information  in  that  it  must  be  used  in  conjunction  with 
additional  forms  to  obtain  all  required  data.  The  possible  combinations  of 
forms  that  can  be  used  to  supplement  form  349  is  almost  unlimited,  depending 
upon  the  hardware  under  evaluation.  Therefore  the  choice  of  forms  to  be  used 
must  be  based  upon  the  particular  system  to  be  evaluated  and  the  type  of  analy- 
sis involved.  Specific  instructions  for  completion  of  this  form  are  contained  in 
Technical  Orders  00-20-2,  00-20-2-2,  00-20-2-4  through  00-20-2-8,  00-20-2-10, 
and  00-20-2-13.  Each  of  these  technical  oi’ders  addresses  specific  hardware 
applications  and  information  content  pertaining  to  the  form. 


4-2.'5 


TABLK  4-3a.  MATRIX  OF  PRIMARY  Ft)RMS  AND  THKIR 
HARDWARK  APPLICABILITY  (Sheet  1 of  2) 


TAHLK  4-;}a.  (Shoot  2 of  2) 
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(b)  A FTP  Form  350  — Reparable  Item  Processing  Tag. 

(Figure  4-3b) 

This  form  is  used  with  form  349  for  all  reparable  items 
removed  from  a system.  It  remains  with  the  item  until  that  item  is  disposed 
of  (serviceable  or  condemned).  The  same  technical  orders  for  form  349  apply 
to  this  form. 
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Figure  4-3b.  AFTO  Form  350 
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(c)  AFSC  Forms  258  and  258-4  - Mainteiiiuice  Discrepancy/ 
Production  Credit  Record.  (Figure  4-3c) 

1.  AFSC  forms  258  and  258-4  are  used  to  document  specific 
types  of  maintenimce  actions,  and  their  layout  and  Information  content  are 
identical.  These  forms  were  developed  for  the  collection  of  effectiveness  data 
during  operational  tests.  The  information  content  Is  similar  to,  but  more 
comprehensive  than,  that  found  on  the  AFTO  form  349.  The  most  significant 
difference  is  the  expanded  narrative  portion,  which  can  be  stored  in  the  com- 
puter; and  the  "Delay  Code",  "GSE",  and  "T.O.  Evaluation"  blocks.  O'hc 
asterisks  shown  in  figure  4-3c  indicate  information  not  found  on  form  349.) 
However,  supplemental  information  must  be  collected  pertaining  to  the  equip- 
ment mission  to  complete  the  data  element  requirements  for  logistics 
assessment. 


2.  Those  forms  were  developed  to  provide  Inputs  into  the 
System  Effectiveness  Data  System  (SEDS).  SEDS  has  been  revised  and 
improved  and  is  now  called  the  Machine  Independent  Systems  Effectiveness 
Data  System  (MISEDS),  for  which  the  Air  Force  Flight  Test  Center,  Edwards 
Air  Force  Base,  CA,  has  responsibility.  Instructions  for  completion  of  these 
forms  are  found  in  AFSC's  Maintenance  Technical  Directive  69-1. 

(d)  AFFIX  Form  300  - Aircraft  Debriefing  Record. 

(Figure  4-3d) 

This  form  is  totally  aircraft-mission  oriented  and,  when 
combined  with  AFSC  form  258  or  AFTO  form  349,  provides  a significant 
amount  of  data  applicable  to  assessments.  The  form  was  developed  by  the 
Air  Force  Flight  Test  Center,  Edwards  AFB,  and  appears  to  be  applicable  to 
a variety  of  aircraft  test  efforts.  Instructions  for  the  completion  of  this  form 
are  provided  in  appendix  4-3A. 
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Figure  4-3d,  AFFTC  Form  300 
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^ ) AFTO  781  Scries  Forms. 
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This  series  of  forms  provides  a maintenance,  inspection 
service,  configuration,  status,  and  flight  record  for  the  particular  weapon 
or  support  system  with  which  the  forms  have  been  designated  for  use.  In 
a test  environment,  their  application  will  depend  on  the  type  of  information 
required  for  assessment  puiposes.  They  can  be  used  in  a variety  of  ways 
to  supplement  the  collection  of  data.  Instructions  for  the  preparation  of 
these  forms  are  found  in  sections  II  and  III  of  Technical  Order  00-20-5. 
Forms  in  this  series  deemed  applicable  to  operational  test  and  evaluation 
are  discussed  in  the  following  paragraphs. 


1.  AFTO  Form  781  — Aerospace  Vehicle  Flight  Data 


Document.  (Figure  4-3e) 


Recorded  on  this  form  are  the  names  of  the  pilot  and 
aircrew  members,  and  pertinent  information  concerning  each  flight.  The 
form  is  used  in  conjunction  with  AFTO  form  78111. 
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AEROSPACE  VEHICLE  FLIGHT  DATA  DOCUMENT 


Figure  4-3e.  AFTO  Form  781 
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2.  AFTQ  Form  781A  — Maintenance  Discrepancy  and 
Work  Document.  (Figure  4-3f) 

This  form  is  used  to  document  each  discrepancy  dis- 
covered by  the  aircrew  or  maintenance  personnel.  The  form  provides  a his- 
torical record  of  all  discrepancies  and  the  actions  taken  to  correct  the  problem. 


Figure  4-3f.  AFTO  Form  781A 


3.  AFTO  Form  781E  — Accessory  Replacement  Document. 

(Figure  4-3g) 

The  purpose  of  this  form  is  to  provide  data  that  will 
facilitate  compliance  with  inspection,  replacement,  and  suspension  require- 
ments as  specified  in  the  applicable  maintenance  manuals.  It  also  provides 
required  information  when  reporting  discrepancies. 


Figure  4-3g.  AFTO  Form  781E 


4.  A FTP  Form  781F  — Aircraft  Flight  Report  and 

Maintenance  Record  (New  title  is  Aerospace  Vehicle 
Flight  Report  and  Maintenance  Document). 

(Figure  4-3h) 

This  form  identifies  the  system  for  which  the  particular 
series  of  781  forms  is  applicable.  It  acts  as  a cover  sheet  for  the  other  attached 
forms. 


Figure  4-3h.  AFTO  Form  781F 
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5.  AFTO  Form  781H  - Aerospace  Vehicle  Flight  Status 
aad  Maintenance  Document.  (Figure  4-3i) 

This  form  documents  maintenance  status  and  servicing 
information  that  will  provide  operating  personnel  a ready  reference  as  to  the 
status  of  the  aerospace  vehicle.  The  form  also  indicates  the  status  and  history 
of  inspections  specifically  related  to  dally  operating  activities. 

6.  AFTO  Form  781J  -Aerospace  Vehicle-Engine  Flight 
Document.  (Figure  4-3 j) 

The  purpose  of  this  form  is  to  document  aerospace 
vehicle  time  and  engine  data,  including  operating  time.  It  provides  a r>mning 
historical  record  of  these  two  items,  which  are  important  in  performing 
assessments. 


7.  AFTO  Form  781K  - Aerospace  Vehicle  Inspection, 

Engine  Data,  Calendar  Inspection,  and  Delayed 
Discrepancy  Document.  (Figure  4-3k) 

This  form  provides  additional  information  concerning  the 
aerospace  vehicle's  status  and  supplements  the  information  contained  on 
form  781J. 
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(f)  AF  Form  1534  - Engine  Status  Report. (Figurp  4-31) 

This  form  provides  for  detailed  information  concerning  the 
condition  of  each  aerospace  vehicle  engine  in  the  inventory.  From  a test  and 
evaluation  point  of  view,  the  form  can  provide  significant  historical  information, 
as  well  as  certain  data  elements  for  assessment.  Instructions  for  preparing 
this  form  appear  in  AFM  400-1,  Volume  11,  Selective  Management  of  Propulsion 
Units. 
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(g)  AFTO  Form  4 - Operating  Time  Report  for  Selected  Items. 
(Figure  4-3 m) 

This  form  records  elapsed  time  indicator  (ETI)  readings  for 
selected  Items  installed  on  aircraft  or  missiles,  or  on  designated  aircraft.  The 
Information  provided  by  the  form  is  useful  for  assessment  efforts.  Instructions 
for  completing  this  form  appear  in  TO  00-20-10-2. 
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(h)  AFTO  Form  208  — Component  Replacement  Record. 

(Figure  4-rtn) 

This  form  provides  a means  of  maintaining  a current  record 
of  items  requiring  replacement  at  specified  calendar  times,  operating  hours,  or 
cycles.  It  also  provides  a historical  summary  of  when  these  replaeements 
occurred.  Instructions  for  this  form  are  found  in  TOs  00-20-6  and  00-20-7. 


Figure  4-3n.  AFTO  Form  208 


(i)  AFTO  Form  4 13  - Trainer/AGE  Status  and  Operating  Record. 

(Figure  4-3o) 

This  form  provides  a means  for  recording  scheduled 
Inspections,  power-on  operating  time,  and  condition  status  for  training  equip- 
ment and  powered  aerospace  ground  equipment.  TO  00-20-6,  Section  IX,  and 
TO  00-20-7,  Section  III,  present  instructions  for  preparing  this  form. 

(j)  AFTO  Form  444  - Trainer/AGE  Maintenance  Record. 

(Figure  4-3p) 

This  form  is  an  equipment  maintenance  document  used  in 
conjunction  with  AFTO  form  443  to  record  selected  maintenance  requirements 
and  their  accomplishment.  TO  00-20-6,  Section  X,  and  TO  00-20-7,  Sec- 
tion IV,  contain  Instructions  for  completing  this  form. 
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Figure  4-3q,  AFTO  Form  454 


(k)  AFTO  Form  454  — Nonpowered  AGE  llecord,  (Figure  4-3q) 


This  form  is  used  to  document  Inspection  requirements  and 
accomplishments,  modifications,  repair  actions,  and  delayed  discrepancies  on 
nonpowered  AGE  or  trainers.  TO  00-20-6,  Section  XI,  and  TO  00-20-7,  Sec- 
tion V,  provide  Instructions  for  filling  in  this  form. 
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(1)  AFTO  Form  136  — Precision  Measurement  Equipment  (PME 


Record.  (Figure  4-3r) 

This  form  is  associated  with  PME  to  document  the  type  of 
equipment  and  information  associated  with  calibration  of  the  equipment.  It  also 
provides  a historical  record  pertaining  to  each  inspection  and  calibration  inter- 
val. Information  pertaining  to  the  use  and  instructions  for  completion  of  this 
form  are  contained  in  TO  00-20-14. 
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Figure  4-3r.  AFTO  Form  130 
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(m)  A FTP  Form  210E  — On-Equipment  Support,  General  Work 
and  Minor  Fix  Maintenance.  (Figure  4-3s) 


AFTO  form  210E  provides  for  documentation  of  the  accom- 
plishment of  scheduled  inspections  for  ground  communications,  electronics, 
meteorological  (CEM)  equipment.  This  form  is  a partially  prepunched  card  that 
requires  some  manual  entries,  and  is  used  with  mechanized  Inspection  schedul- 
ing system.  Instructions  and  usage  of  the  form  are  delineated  in  TO  00-20-10-3, 


Figure  4-3s.  AFTO  Form  210E 
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(n)  AF  Form  2445  — Job  Control  Document.  (Figure  4-3t) 

One  unique  application  of  the  AF  form  2445  is  to  provide 
inventory  and  status  information  on  ground  OEM  equipment.  Instructions  for 
this  form,  when  used  for  the  above  purpose,  are  contained  in  AFM  65-255  (to 
be  replaced  by  AFM  65-662)  and  AFM-66-1,  Volumes  10  and  11,  From  a test 
and  evaluation  point  of  view,  this  form  can  be  used  to  report  selected  mainte- 
nance information  on  all  hardware  types  listed  in  table  4-3a.  Its  use  is  not 
restricted  to  CEM  equipment. 
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(o)  Supplemental  Forms. 

The  Air  Force  has  developed  a multitude  of  forms  for 
recording  a wide  variety  of  information.  A selection  of  forms  to  supplement 
those  presented  in  table  4-3a  is  provided  by  table  4-3b.  Through  a form  selec- 
tion process,  from  these  two  tables  the  majority  of  test  information  can  be 
documented  for  assessment  purposes.  Examples  of  the  forms  listed  in 
table  4-3b  are  contained  in  appendix  4-3B. 

(p)  Other  Forms. 

Two  additional  forms  worthy  of  discussion  are  AF  forms  359 
and  359a  (figure  4-3u),  both  associated  with  the  Maintenance  Management  Infor- 
mation Control  System  (MMICS).  When  the  second  Increment  of  MMICS  is 
implemented  Air  Force-wide,  these  two  forms  will  become  obsolete.  Until  that 
time  they  will  be  available  and  can  be  used  for  data  collection  purposes.  Use  of 
these  forms  or  derivatives  may  continue  if  prescribed  by  test  plans.  Instruc- 
tions for  the  use  and  preparation  of  these  forms  are  contained  in  the  following 
Air  Force  Manuals: 

U AFM  65-260,  Aerospace  Vehicle  Inventory,  Status  and 
Utilization  Reporting. 

2.  AFM  65-272,  Trainer  Equipment  Inventory,  Utilization 
and  Status  Reporting  System. 

3.  AFR  65-110,  Standard  Aerospace  Vehicle  and  Equip- 
ment Inventory,  Status  and  Utilization  Reporting. 

(q)  Special  Forms. 

Certain  test  programs  may  require  the  use  of  special  forms. 
Such  forms  can  be  designed  by  applying  the  following  general  procedure: 

The  specific  data  elements  to  be  collected  are  identified, 
along  with  their  measurement  units  (hours,  cycles,  etc.). 


2.  Data  element  definitions  are  developed  if  they  do  not 


exist. 


3.  Supplementary  Information  such  as  end  item  identifica- 
tion, date,  test  program,  location,  etc.,  are  determined. 

4.  A format  for  the  form  is  developed.  The  layout  should 
Include  space  for  notes,  comments,  names  of  team  members,  and  other  general 
Information  pertinent  to  the  test  program.  Form  layout  may  require  several 
iterations  before  an  adequate  format  Is  obtained.  Simplicity  should  always  be 
the  key  element  in  designing  a form. 
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TABLE  4-3b,  MATRIX  OF  SUPPLEMENTAL  FORMS  AND 
THEIR  HARDWARE  APPLICABILITY  (Sheet  1 of  2) 

I Hardware  Applicability 


i A/ 

i HI  h 

l/l/l/ 


Primary  Air  Force  Form 


AtTO  Form  -l-l.  Turbine  Wheel  Iliatorical  Record 


AFTO  Form  95,  SlgnUlcimt  lliatorlcii)  Record 


AFTO  Form  100,  Aircraft  Data  Record 

AFTO  Form  lOOA,  Accessory  Roplacement 
Record 

AFTO  Form  102,  Munition  Inspection  Document 

AFTO  Form  103,  Alrcraft/Mlsslle  Condition 
Report 

AFTO  Form  105,  Inspection  Maintenance  Firing 
Data  for  Ground  Weapons 

AFTO  Form  119,  011  Analysis  Request 

AFTO  Form  U9A,  Oil  Analysis  Record 

AFTO  Form  120,  Klectron  Tube  Field  Mfe  Record 

AFTO  Form  120A,  LToctron  Tube  Performance 
and  Status  Report 

AFTO  Form  15H,  Technical  Order  Review 
Comment  Sheet 

Al-TO  Form  207,  Status  and  Operational  Record 

AFTO  Form  209,  Maintenance  Log 

AFTO  Form  223,  Time  Change  Requirements 
Forecast 

AFTO  Form  791D,  Calendar  luid  Hourly  Item 
Inspection  Document 

AF  Form  991,  Recoi-d  of  Cannibalization 


AF  Form  2400,  Job  Standard 


AF  Form  2401,  Equipment  Utilization  and 
Maintenance  Schedule 

AF  Form  2403,  Weekly  Aircraft  lltlllzation/ 
Maintenance  Schedule 


/p  /•/  Xl-sl  ^ I '^J^J  * 

■S  s s h”  3 S H S W#/ S ii 


X X X X XX  XXX 


X X X X X X X X 


X X X X X X X X 


X X X X X X X X X 


T.O.  00-20-5 
T.O.  00-20-fi 

T.O.  00-20-4, 
-20-(i,  -20-7, 
-20-H 

T.O.  00-20-5 
T.O.  00-20-5 


T.O.  IIA-I-IO 


T.O.  00-25-4 


T.O.  llW-1-10  I 


T.O.  42R2-1-9 


T.O.  42R2-1-9 


T.O.  00-20-8 


T.O.  00-20-8 


T.O.  00-5-1 


T.O.  00-20-0 


T.O.  00-20-0 


T.t^.  00-20-9 


T.O.  00-20-5 


T.t>.  00-20-2 
T.O.  00-20-4 

AFM  (Ui-l, 
Vol.  2 

AFM  Ofi-1, 
Vols.  2 and  9 

AFM  06-1. 
Vol.  2 
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TABLE  4-3b.  (Sheet  2 of  2) 


Hardwire  AppUcablilty 


Primurv  Air  Koix’i*  Korm 


At  Form  240i>,  Mainteaunco  I’ropUm 


AF  Form  2410,  Inspeolum-TCTO  Phmninn 
c'ht'ckshool 

AF  Form  2412,  Flinht  Status  Hegisior 


AF  Form  2410,  Personnel  Crew  Kvaluatum  Heport 


AF  Form  2417,  Technical  Inspi*ction  i\)inls 
Con\putalion 


AF  Form  24l»*,  Personnel  Evaluation  ami  Points 
Compulation 

AF  Form  2420,  Quality  Control  Inspt'ctioo  Summary 
AF  Form  2422,  Maintenance  Analysis  Heferral 


AF  Form  2423,  Technical  t^rder  Improvement  or 
I nsntisfactorv  Materiel  Heports  Lor 


AF  Form  300,  NORS  PetaiJ  Data 

AF  Form  2424,  Maintenance  Traininp  Document 

AF  Form  2431,  Aerospace  Grouml  Equipment 
Status 

AF  Form  2435,  IxJad  Training  and  Certification 
Document 

AF  Form  2436,  Weekly /Daily  Aircraft  Utilization 
Soht>dule 

AF  Form  2443,  Shop  Workload  Summary 


AF  Form  244S,  Personnel  Evaluation  Report 
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AEROSPACE  VEHICLE  DATA  MANUAL 


AF  Forms  359  and  359a 


I 

N 

’ 5.  A set  of  instructions  for  the  form  is  prepared.  If  only  a 

few  instructions  are  required,  they  may  be  printed  on  the  back  of  the  form. 

Longer  and  more  detailed  instructions  may  require  the  development  of  a multi- 
page document.  These  instructions  should  describe  the  utility  of  the  form  and 
its  intended  applications,  as  well  as  present  details  concerning  the  completion 
of  the  form. 

(2)  Data  Element  Summary. 

' (a)  Based  on  the  forms  presented  in  figures  4-3a  through  4-3t, 

a matrix  was  developed  that  readily  identifies  the  data  elements  that  can  be  ' 

obtained  from  each  listed  form.  Conversely,  the  matrix  provides  for  easy 
idenafication  of  the  form  to  use  when  the  required  data  elements  have  been 
established.  This  matrix  appears  as  table  4-3c. 

I 

(b)  As  table  4-3c  demonstrates,  at  least  two  forms  are  required 
to  obtain  all  data  elements  listed.  Either  AFTO  form  349  or  AFSC  form  258  can 

be  used  with  AFFTC  form  300  to  collect  most  of  the  listed  elements.  As  j 

previously  Indicated,  form  349  does  not  provide  all  the  data  elements  contained 

on  form  258.  However,  both  contain  the  critical  data  elements  needed  for  most  j 

quantitative  R&M  computations.  j 

J (c)  Form  349  has  blocks  14  and  15  unassigned  for  specific  infor- 

I mation;  these  two  blocks  can  be  used  to  collect  additional  data  elements.  AFSC 

form  258  has  blocks  F,  23,  and  24  unassigned,  which  can  similarly  be  desig- 
nated for  specific  required  elements.  In  both  cases,  the  type  of  information  that 
could  be  collected  would  depend  on  the  test  program  being  conducted. 

1 (3)  Logistics  Data  Sources. 

j During  a test  program,  it  is  often  necessary  to  determine  the 

i relative  merits  of  one  or  more  pieces  of  hardware.  For  certain  logistics 

parameters,  program  documentation  may  not  provide  values  for  comparison 
' with  those  achieved  during  OT&E  activities.  Several  possible  sources  of  docu- 

mented values  are  available,  as  discussed  below. 

! (a)  Government/industry  Data  Exchange  Program  (GIDEP). 

As  the  name  of  this  data  program  implies,  both  the  Govern- 
ment and  Industry  participate  in  the  mutual  exchange  of  information  on  all  types 
of  military  hardware.  GIDEP  is  managed  by  the  Naval  Material  Command, 

Washington,  D.C.  The  operations  center  is  located  at  the  Fleet  Missile 
Systems  Analysis  and  Evaluation  Group,  Corona,  CA,  where  technical  opera- 
tions are  carried  out.  Participants  in  the  program  are  users,  rather  than 
• manufacturers,  of  parts  and  components.  Specialized  data  banks  maintained 

within  this  storage  and  retrieval  system  are  as  follows: 

1 

The  Engineering  Data  Bank  contains  engineering  evalua- 
tion and  qualification  test  reports,  nonstandard  parts  justification  data,  parts/  i 

' material  specifications,  manufacturing  processes,  failure  analysis  data,  and 
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TABLE  -i-Wc.  MATRIX  OF  DATA  ELEMEN  TS  VS 
AIR  ECMICE  FORMS  (Sheet  1 of  2) 


Oobt'onlml  NumlKM*  Numln'r* 

Work  Cot\ii*r 

llRto  This  Uepoi't 

A ct  i V 1 1 V Ido  tit  i l ie  at  io  ti 

Knd  Item  tKU  Idonlilicalioti 

Si' rial  NundxM*  KI 

Possessed  Time  LI  (Nolo 

Time  Milos  Ovcios  Kvoats  K1 

Numik'rol  l andings  Kl 

Numlior  ol  Sorties  LI 

Hate  of  Mission 

Start  of  Mission  iTtiiioi 

Lnd  of  Mission  (Timoi 

Mission  Tvpt' 

Dporating  Mode 'Mission  Phase 
Time  in  LTich  Mode  Phase 
Manufacturer  Failed  Items  (FH 
Serial  Number  Kl 
Part  NumlK'r  Kl 

Time^Miles''Cvclos  Kvents  Kl  * 

Work  I’nit  Code  (Wl'Cl* 


•Critical  for  most  Mlt-M  computations. 

NOTES:  (U  Engines  onlv 

(2)  Chock  marks  for  these  data  elements  consider  possessed  time  and  time  miles  eveles  events 
to  be  synonymous. 


I 


Data  Clement 

When  Discovered  Code,  Date,  Time* 

How  Malfunctioned  Code* 

Action  Taken  Code* 

Type  Maintenance  Code* 

Description  of  the  Problem 

Corrective  Action  (Maintenance  Action  Taken) 


Primary  Air  Force  Form 

iff  fs ! lx  i / / /A#/  III 

/v/sf/«j7o /v  V'vV'V  V V f/c/vV'V  V V 

/t/t/t/t/t/t/  t/t/t/t/t/t/t/t/t/t/t/t/  t /t  / 

X X X X X XX 

X X X X X 

X X X X 


X X X X 


Piece  Parts  Replaced 
I' nits  Completed 


Manufacturer  Installed  Item  (II) 


Serial  Number  II 


Part  Number  II 


Time/Miles/Cycles/Events  II 
Air  Force  Specialty  Code  (AFSC) 
Crew  Size  (by  AFSC)* 

Start  Time  (Maintenance)* 

Stop  Time  (Maintenance)* 

Delay  Code  (Maintenance) 

Support,  General  Maintenance 
Nonsupport.  General  Maintenance 


*Crttlcal  for  most  RfcM  computations. 

NOTES:  (1)  Engines  only 

(2)  Check  marks  for  these  data  elements  consider  possessed  time  and  time  'miles  cvclos 'events 
to  be  synonymous. 


othei’  related  engineering  information  on  parts,  components,  materials,  and 
processes.  The  bank  includes  a section  of  reports  on  specific  engineering 
methodology  and  techniques. 

2.  The  Failure  Rate  Data  Bank  (formerly  FAIIADA)  contains 
failure  rate/mode  data  on  parts  and  components  based  on  field  performance 
information  and  on  reliability  demonstration  tests  of  operational  systems  and 
equipment.  Not  included  in  the  computations  are  failures  classified  as  secondary 
or  accident-dependent,  burn-in/infant  mortality,  wear-out,  or  unconfirmed. 

The  Metrology  Data  Bank  contains  test  equipment  cali- 
bration procedures  and  related  metrology  engineering  data  on  test  systems, 
calibration  systems,  and  measurement  technologj". 

■1.  The  Failure  Experience  Data  Bank  contains  failure 
information  generated  whenever  significant  problems  are  identified  on  parts  and 
materials. 


(b)  Reliability  Analysis  Center. 

The  Rcliabilitj'  Analysis  Center,  an  established  DoD  opera- 
tion administered  by  the  Rome  Air  Development  Center  (RADC),  provides  for 
the  dissemination  of  reliability  and  experience  information  on  microelectronic 
and  discrete  semiconductor  devices.  The  center  analyzes  and  disseminates 
information  generated  during  all  phases  of  device  fabrication,  testing,  equip- 
ment assembly,  and  operation.  Data  files  are  continually  updated  through  infor- 
mation collected  from  device  and  equipment  manufacturers,  system 
contractors,  and  field  operations.  Collection  efforts  concentrate  on  failure 
mode  and  mechanism  analysis;  material,  device,  and  process  technology; 
quality  assurance  and  reliability  practices;  test  results;  and  application  experi- 
ence. Information  concerning  this  center  can  be  obtained  from  RADC,  Griffis 
Air  Force  Base,  N.  Y.  13440. 

(c)  Air  Force  Operational  Test  and  Evaluation  Management 
■ information  System  (OTEMIS). 

1_,  OTEMIS  is  an  automated  data  system  currently  compris- 
ing three  files  of  information: 

£.  Reports  — Bibliographic  information  and  abstracts 
of  test  plans,  test  reports,  and  studies  relative  to  Air  Force  OT&F  problems. 

b.  Status  — Information  on  all  AFTEC-managed/ 
monitored  test  programs. 


c.  Data  - Catalogs  all  available  test  data  from 
AFTEC-conducted  test  programs. 

2.  The  AFTEC  Directorate  of  Analysis  (OA>  manages  and 
is  responsible  for  the  reports  and  data  files.  The  Directorate  of  Flans  and 
Rcsoui'ces  (XR)  is  responsible  for  the  status  file.  Information  concerning  the 


4-5fi 


contents  and  usaRc  of  the  reports  and  data  files  Is  provided  In  AFTKCU  55-1, 
Chapter  11.  Additional  support  concerning  operation,  usage  and  contents  of 
t^TEMIS  can  be  obtained  from  Xlt. 
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Configuration  Management. 


(a)  Configuration  management  is  the  discipline  of  applying  tech- 
nical and  administrative  direction  and  surveillance  to  Identify  and  document 
functhuial  and  physical  characteristics  of  a configuration  item;  to  control 
changes  to  those  characteristics;  and  to  record  and  report  i-hange  pi'ocosaing 
and  Implementation  status  (Doll  Directive  5010.11)1.  Configuration  management 
comprises  configuration  identification,  configuration  tsmirol,  and  configuration 
status  accounting.  The  following  definitions  and  terms,  all  fnuu  DoD 
Directive  5010.19,  apply  to  this  discipline. 


Configuration  Item  (Cf)  - An  aggregation  of  hardware/ 
software,  or  any  of  its  discrete  portions,  that  satisfy  an  end  use  function,  and 
Is  designated  by  the  Covernment  for  configuration  management.  Cls  may  vai'j' 
widely  In  complexity,  size,  and  typo,  for  an  aircraft  system  to  a test  meter  or 
round  of  ammunition.  During  development  and  initial  production,  Cls  are  only 
those  specification  items  that  are  referenced  directly  in  a contract  (or  an 
iHiulvalent  In-house  agreement).  During  the  operation  and  maintenance  period, 
any  reparable  Item  designated  for  separate  procurement  is  a conflgiiratlon  item. 


2.  Configuration  Identification  — The  currently  or  condi- 
tionally approved  technical  documentation  (or  a conflguratit)n  item  as  set  forth 
In  specifications,  drawings  and  associated  lists,  and  doevunents  referenced 
therein. 


5.  Configuration  Control  - The  systematic  ev^aluatlon, 
coordination,  approval,  or  disapproval,  and  lmplem<’ntation  of  all  approved 
changes  in  the  configuration  of  a Cl  after  formal  establishment  of  its  configura- 
tion identification. 


Configuration  Status  Accounting  - The  recording  and 
reporting  of  the  Intormatlon  needed  to  manage  configurations  effectively.  Includ- 
ing a listing  of  the  approved  configuration  identification,  the  shUus  of  proposed 
changes  to  a configuration,  and  the  implementation  stains  of  approved  changes. 

(b)  When  AFTFIC  receives  an  end  item  fi>r  test  and  evaluation, 
configuration  management  for  that  end  Item  should  have  already  Ihhui  Imple- 
mente«l  by  the  contractor.  That  is,  configuration  identi  ficatioi\,  configuration 
control,  and  configuration  status  accounting  activities  should  exist  in  accordance 
with  AKI,C/AFSC  Manual  575-7,  Configuration  Management  for  Systems, 
Fqulpment,  Munitions  and  Computer  Progx-ams.  The  exact  configuration  of  each 
item  Im*  tested  should  1h’  documented  and  accompany  the  delivery  of  the  end 
item.  When  more  than  one  end  item  Is  to  luidergo  test  and  c'valuation,  a com- 
Itarlson  should  Ix'  made  betw-een  configurations  to  determine  their  degree  of 
similarity,  utilizing  the  deviations,  waivers  and  shoi-tages  list.  Differences 
m eonliguratlons  can  affect  the  tost  results  rn<’  the  conclusions  reached  from 
* iluatlng  these  results. 
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(c)  The  importance  of  confiRuration  manaRement  to  AFTKC  is  to 
assure  that  each  end  item  under  test  is  of  the  latest  approved  confiRuration,  that 
each  like  end  item  comprises  the  same  or  nearly  the  same  confiRuration  items, 
and  that  an  up-to-date  status  accountinR  is  maintained  concerninR  the  incorpora- 
tion of  approved  enRinecrinR  chanRc  proposals  (ECPs)  and  time  compliance 
technical  orders  (TCTOs).  ConfiRuration  manaRcment  also  provides  a method 
for  keepinR  track  of  special  equipment  installed  on  an  end  item  for  implementinR 
unique  mission  applications. 

(d)  If  confiRuration  manaRement  techniques  have  not  been  applied 
or  required  on  an  end  item,  AFTEC  should  implement  a manual  proRram  as 
follows: 

ConfiRuration  items  for  each  end  item  should  be  identi- 
fied by  name,  maniifacturer,  serial  number,  part  number,  drawinR  number, 
and  revision.  Any  special  features  or  uses  for  these  CIs  should  also  be 
indicated. 

A baseline  should  be  established  for  each  Cl.  This 
baseline  is  continRent  upon  the  status  of  incorporated  ECPs  and  TCTOs. 

3.  A listinR  of  all  approved  ECPs  and  TCTOs  should  be 
obtained  from  the  System  ProRram  Office  (SPO),  alonR  with  their  development 
status. 

4.  A series  of  AFTO  form  95s  can  then  be  prepared  for 
each  Cl  identified  f^r  the  end  item. 

Thus  a historical  file  is  developed  for  each  end  item,  and  appropriate  entries 
can  be  made  as  chanRes  are  incoi-porated. 

(e)  TO  00-20-4,  ConfiRuration  ManaRement  Systems,  delineates 
documentation  requirements  for  both  manual  and  automated  confiRuration  status 
reportinR.  Guidance  is  provided  for  the  preparation  of  AFTO  form  95,  and 
four  confiRuration  status  systems  are  described.  Additional  information  and 
Ruidance  can  be  obtained  from  the  latest  versions  of  Military  Standards  480 
throuRh  483. 
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4-4.  DATA  REDUCTION  AND  ANALYSIS. 


The  possible  types  of  information  that  may  enter  into  logistics 
assessments  are  many  and  varied.  This  section  provides  guidance  for  the 
reduction  and  analysis  of  data  associated  with  the  parameters  presented  in 
tables  4-2a  (Reliability),  4-2c  (Maintainability),  4-2e  (Availability),  and  4-2g 
(Supportablllty).  For  large  quantities  of  data,  these  techniques  can  also  be 
implemented  by  one  or  more  of  the  data  processing  systems  discussed  in  sec- 
tion 4-5.  A cross  reference  of  parameters  and  data  systems  that  will  calculate 
these  parameters  is  provided  by  table  4-5b.  When  a parameter  can  be  used  in 
the  evaluation  of  more  than  one  factor  (e.  fe. , mean  time  to  repair  is  both  a 
maintainability  and  availability  parameter),  it  is  discussed  the  first  time  it 
appears,  but  the  discussion  is  not  repeated  for  subsequent  applications. 

a.  Reliability  Parameters. 

Criteria,  ground  rules,  and  basic  equations  for  calculating  the  reli- 
ability parameters  listed  in  table  4-2a  are  presented  below.  In  all  instances 
these  calculations  provide  point  estimates  for  each  of  the  parameters.  Statisti- 
cal procedures  for  developing  confidence  Intervals  for  these  parameters  are 
discussed  in  subsection  4-4e. 

(1)  Criteria  and  Ground  Rules. 

When  evaluating  the  reliability  parameters  listed  in  table  4-2a, 
the  following  criteria  and  ground  rules  apply:  (NOTE:  In  using  these  criteria 
and  ground  rules,  failures  should  be  recorded  by  categories  for  later  use  in 
problem  area  identification  and  end  item  evaluation.) 

(a)  Failures  of  redundant  components  will  be  included  in  compu- 
tation of  hardware  MTBF,  but  not  of  flight  i-eliability  or  inflight  aborts.  Only 
the  one  primary  component  causing  an  abort  will  be  counted  for  flight  reliability 
or  inflight  abort. 

(b)  The  following  will  be  counted  as  failures: 

1.  A component  operated  beyond  its  specified  environmental 
and/or  performance design  limits,  and/or  maintenance  requirements. 

2.  Equipment  that  falls  even  though  not  properly 

maintained. 

3.  Failures  caused  by  maintenance  or  pilot  error. 

4.  Secondary  or  Induced  failures. 

5.  Failures  due  to  Improper  installation. 

fi.  A repeat  or  recurring  failure  that  was  not  confirmed 
when  previously  reported  one  or  more  times.  (AFM  fifi-1  definitions  of  repeat 
and  recurring  failures  apply.) 
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, 7.  Failures  of  equipment  not  in  its  qualified/production 

configuration. 

8,  Equipment  requiring  adjustment  or  calibration  to  return 
it  to  a ready-for-installation  status. 

(c)  If  an  item  is  damaged  or  maintenance  errors  induced  by 

I item  design  complexity,  by  poor  design  practice,  or  by  following  improper  pro- 

j ccdures  that  allow  improper  maintenance  (e.g. , interchangeability  of  con- 

' nectors)  without  proper  caution  in  the  technical  manuals,  the  failure  shall  be 

chargeable.  Even  when  corrective  action  concerning  the  improper  procedures 
or  deficiencies  has  been  completed,  the  failure  shall  not  be  deleted. 

(d)  Failure- 

4 

Data  System  Failure  Categories.  , 

a.  Type  1 Failure.  This  category  Indicates  that  the  j 

item  no  longer  can  meet  the  minimum  specified  performance  requirement  due  to  ; 

its  own  internal  failure  pattern.  (How  malfunctioned  codes  not  listed  as  type  2 ' 

' or  fi  below  are  considered  to  be  type  1.)  Only  type  1 failures  are  used  by  DOSfi  j 

to  express  MTBF.  ] 

I 

I 1)  The  computer  definition  of  a failure  condition  at 

the  five-position  WUC  level  Is: 

a)  Any  type  1 how  malfunctioned  code  in  com- 
bination with  an  action  taken  code  F,  K,  L,  or  Z.  (See  appendix  4-2a  for 
I description  of  how  malfunctioned  and  action  taken  codes.) 

i ; 

' b)  Any  type  1 how  malfunctioned  code  in  com- 

! bination  with  an  action  taken  code  P or  R,  provided  that  the  removed  item  was 

not  found  serviceable  (action  taken  code  B)  at  the  bench  check  station. 

2)  The  computer  definition  of  a failure  condition  at 
the  two-  and  three-position  WUC  level  (system  and  subsystem)  is  the  same  as  at 
j the  five-position  WUC  level,  plus  any  type  1 how  malfunctioned  code  in  combi- 

I nation  with  action  taken  code  G for  each  five-position  WUC.  (At  the  five- 

position  WUC  level,  action  taken  code  G with  a tjT>e  1 how  malfunctioned  code  is 
identified  as  "Other  Malfunction".) 

b.  Type  2 - Induced  Failure.  These  how  malfunctioned 
codes,  when  used  with  action  taken  codes  F,  G,  K,  I-,  P,  R,  or  Z,  Indicate  that 
the  item  no  longer  meets  minimum  specified  performance  requirement  due  to 

: some  Induced  condition  and  not  due  to  its  own  Internal  failure  pattern;  088,  092, 

105,  106,  108,  158,  168,  204,  230,  246,  301,  303,  424,  447,  518,  553,  602,  j 

638,  639,  697,  698,  709,  731,  877,  878,  931,  942,  948.  , | 

c.  Type  6 - No  Defect.  These  codes  indicate  that 
maintenance  resources  were  emended  due  to  policy,  modification,  location,  or 
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( cannibalization  and  no  defect  existed  at  the  clme  of  maintenance:  632,  793,  796, 

I 797,  798,  799,  800,  801,  802,  803,  804,  805,  812,  911. 

\ i 2 . MDC  Failure  Categories. 

! a.  CODE  A DATA  CLASS  - FAILURE.  An  on-equlp- 

i ment  record  containing  a how  malfunctioned  code  other  than  those  listed  for 

i codes  B,  C,  or  D below.  Only  code  A Is  used  In  determining  failure  data  for  the 

i performance  monitoring  system.  These  how  malfunctioned  codes  are  Included 

! In  the  failure  count  unless  combined  with  action  taken  code  Q or  Y. 

I b.  CODE  B DATA  CLASS  - INDUCED  FAILURE.  An 

r ' on-equlpment  record  containing  how  malfunctioned  code  086,  092,  105,  106, 

108,  158,  167,  204,  230,  246,  301,  303,  447,  424,  518,  553,  602,  638,  639, 

^ : 697,  698,  709,  731,  750,  877,  878,  931,  or  942.  Code  B records  are  not 

I Included  In  the  hlgh-25  on-equlpment  failures,  PCN  SG001B781. 

I I c.  CODE  C DATA  CLASS  - NON-FAILURES.  An 
on-equlpment  record  containing  how  malfunctioned  code  142,  145,  632,  796,  799, 
800,  803,  812  948  or  804  and  type  maintenance  code  not  T or  Z.  Also  Included 
are  A or  B how  malfunctioned  codes  In  combination  with  action  taken  codes  Y or 

1 D.  (Note  that  D056  Includes  codes  142  and  143  as  type  1 failures.) 

] d.  CODE  D DATA  CLASS  - NO  DEFECT,  TCTO.  An 

on-equlpment  record  containing  type  maintenance  code  T or  Z and  how  mal- 
functioned  code  793,  797,  798,  801,  802,  804,  or  911.  (Note:  See  appendix 
4-2A  for  MDCS  data  class  codes  and  how  malfunctioned  codes.) 

'( 

I (e)  Other  Malfunctions.  Other  malfunction  occurrences  are 

defined  (D056)  as: 

Any  type  1 how  malfimctloned  code  In  combination  with 
t an  action  taken  code  G at  the  five-position  WUC.  At  the  system/subsystem 

1 (74XXX/741XX)  level,  a type  1 how  malfunctioned  code  with  action  taken  code  G 

j Is  accumulated  and  shown  as  a failure  and  not  as  another  malfunction. 

i 2.  Type  2 how  malfunctioned  code  and  all  action  taken  codes 

' listed  In  paragraphs  4-4a(l)(d)l  and  2 above. 

> . 

J,  ■ NOTE : The  definitions  In  paragraph  (e)  apply  to 

‘I  i DO56B5505,  D056B5006,  and  D056B5527  products. 

t , 

! J t (f)  Total  Occurrences  (D056).  On-equlpment  occurrences  are 

reported  under  all  valid  how  malfunctioned  codes  (types  1,  2,  and  6)  and  all 
! 1 *'  action  taken  codes  listed  In  paragraphs  4-4a(l)(d)l^  and  2 above,  plus  E,  H,  J,  S, 

n j V,  and  X.  This  expression  Is  used  In  the  D056B5006  for  MTBM.  Time  change 

i events  are  Included.  (NOTE:  There  Is  no  satisfactory  D056  source  of  off- 

( , equipment  maintenance  actions  that  would  be  comparable  to  shop,  or  off- 

i ! equipment,  man-hours  as  used  In  the  D056B5006.  Shop  action  units  used  In  the 
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i 

• ! 

D05fiB500fi  do  not  include  components  that  are  bench  checked  and  require  no 
repair  (action  taken  codes  B,  J,  and  X),  in-shop  support  general  work,  or  work 
associated  with  action  taken  codes  C,  D,  M,  and  N.  The  DOnfiBSSOf),  I'art  II  — 

Shop  Actions,  includes  serviceables  (action  taken  codes  B and  J)  and  delay 
codes  C,  D,  M,  and  N,  but  omits  action  taken  code  X events  and  In-shop 
support  general  activity.  Further,  the  DOSeBSSOf)  is  produced  only  when  a work 
unit  coded  item  exceeds  its  assigned  failure  limit  or  drops  below  the  assigned 
minimum  acceptable  reliability  factor.  While  this  product  may  be  useful  for 
work  unit  code  studies,  it  would  not  be  a practical  source  of  data  for  systems  or 
mission,  design,  and  series  (MDS)  purposes. 

(g)  Only  when  discov'ered  codes  A (before-flight  abort)  and  C 
(in-flight  abort)  are  used  by  nO5GB5006  and  DOSGBSOIS  to  determine  aborts. 

All  type  1 and  2 how  malfunctioned  codes  and  the  following  action  taken  codes  are 
qualification  for  an  abort: 

Type  Maint.  Description 


F Repair 

G Repair  and/or  replacement  of  minor 

parts,  hardware,  and  soft  goods 

K Calibrated  - adjustment  required 

L Adjust  or  reset 

P Removed 

R Remove  and  replace 

Z Corrosion  treatment 

NOTE;  More  than  one  work  unit  code  may  be  reported  for  a 
single  abort,  thereby  overstating  the  abort  rate.  Abort  rates  are  included  only 
in  the  DO56B5015  (based  on  sorties)  and  the  D05RB5527  (based  on  flying  hours) 
products. 

(h)  The  when  dlseovered  codes  listed  below  reflect  aborts, 
mission  failures  or  degraded  alerts  reported  against  the  indicated  end  items. 
AFLC  summarizes  this  information  through  a count  of  the  K97  cards  received 
with  other  than  "zero”  units  reported.  The  count  reflected  for  "on-equipment" 
actions  may  be  duplicated  by  "off-equipment"  actions.  By  comparative  analysis 
of  the  two  maintenance  environments  (line  or  shop)  and  the  item  affected,  a 
relatively  true  assessment  of  abort  causes  can  be  made.  Only  the  following 
codes  are  used  in  D056B5007  for  the  end  articles  Indicated. 
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When 

Discovered 
Code 


Definition 


For  Aircraft,  Mobile  Training  Units.  Air  Launched 
Missiles,  and  Aircraft  Engines 

A Before  Flight-Abort-Air  Crew 

C In  Flight-Abort 

N Ground  Alert-Degraded 

For  Ground  Launched  Missiles  and  Real  Property 
Installed  Equipment 

A Countdown-Abort 

C Simulated  Countdown-Abort 

H Ground  Alert/Operationally  Ready-Degraded 

P Functional/Operational  Check-Result  Bad 

For  Registered  AGE.  Trainers.  Simulators.  Missile 
Class  1 Trainers,  Ground  CEM  and  L Systems 

C During  Equipment  Operation/Caused 

Equipment  Downtime 

For  Munitions 

C During  Operation 

NOTE;  D056B5007  lists  aborts  by  WUC,  date,  and  operating 
time  for  each  equipment  serial  number  in  determining  abort  count,  but  no  abort 
rate  or  sortie  count  is  provided. 


(i)  Before-Flight  Abort.  If  an  attempted  sortie  does  not  become 
airborne  because  of  a failure,  the  criterion  used  will  be  that  applied  by  the 
predominant  using  command  for  operational  forces.  For  example,  in  TAC  an 
abort  occurs  when  an  aircraft  falls  to  take  off  within  2 hours  of  scheduled 
takeoff  time  due  to  maintenance  discrepancies  or  other  causes  discovered  or 
occurring  after  the  scheduled  aircrew  station  time.  For  determining  aborts, 
the  scheduled  takeoff  time  for  aircraft  is  that  agreed  upon  by  maintenance  and 
operations  personnel  prior  to  crew  arrival. 

(j)  Inflight-Abort.  An  airborne  aircraft  cannot  effectively 
accomplish  its  primary  or  alternate  scheduled  mission  due  to  a reported 
malfunction. 


NOTE;  Equations  for  a number  of  parameters  presented 
in  this  and  subsequent  subsections  are  modified  by  an  Inventory  ratio.  This 


Is  a method  of  prorating  data  from  a population  of  similar  items  to  those  end 
items  having  some  special  configuration  or  feature.  When  a small  number  of 
end  items  (fewer  than  6)  are  undergoing  OT&E,  caution  should  be  exercised  in 
using  this  approach.  Small  numbers  of  end  items  should  be  tracked  by  tail  num- 
ber, serial  number,  or  some  other  specific  identification.  Data  accuracy  will  be 
improved  and  the  analysis  effort  will  result  in  more  realistic  parametric 
evaluations. 

(2)  Equations. 

(a)  Mean  Time  Between  Failures  (MTBF) . 

1,  For  aircraft,  AGM  28's,  AGM  fiOA's,  and  aircraft 
engines,  the  D045  formula  is: 


(Flight  Hours)  (Use  Factor)  (QPAj  Special  Inventory 
Quantity  of  Failure  Occurrences  ' Aircraft  Inventory 


where: 

Flight  Hours  are  the  accumulation  of  all  flying  hour  readings  for  the  same 
period  of  time  for  which  failures  were  accumulated. 

Use  Factor  is  the  ratio  of  item  operating  time  to  flying  hours.  (For  OT&F 
reports  the  ratio  used,  if  other  than  1.0,  should  be  so  stated.) 

Quantity  of  Failure  Occurrences  is  the  accumulation  of  failure  occurrences 
during  the  same  period  covered  by  the  operating  time.  The  criteria  and 
ground  rules  of  para.  4-4a(l)  must  be  applied  in  determining  these  failure 
occurrences. 

Special  Inventory  is  the  number  of  different  aircraft  configurations  when  all 
test  items  are  not  equipped  with  one  or  more  particular  WITC  components. 

Aircraft  Inventory  is  the  number  of  aircraft  under  test. 

2.  For  equipment  other  than  aircraft  and  specified  missiles 
the  D056  formula  is: 

^ (Operating  Time)  (Use  Factor)  (QPA)  Special  Inventory 
Quantity  of  Failure  Occurrences  Test  Inventory 


where: 

Operating  Time  is  the  accumulation  of  actual  hours  that  an  item  is  in 
operation  based  on  ETI  readings,  or  is  the  possessed  time  for  that  item. 
When  information  is  available,  NOK  grounded  time  may  be  subtracted  from 
possessed  time  to  determine  operating  time  when  the  latter  is  not 
reported  separately,  although  this  practice  is  not  applied  in  the  D05R 


products.  For  ground  and  air-launched  missiles  (other  than  AGM-28  and 
AGM-69),  CEM,  trainers  and  simulators,  munitions,  and  registered  AGE, 
the  operating  time  entry  in  the  D056  will  be:  APR  65-110  or  B-4  master 
Inventory  x 30  days  x Inventory  ratio. 

Use  Factor  is  the  ratio  of  item  operating  time  to  possessed  time.  This 
ratio  is  1.00  when  operating  time  is  used  in  lieu  of  ETI  readings. 

Quantity  per  Application,  Quantity  of  Failure  Occurrences,  and  Special 
Inventory  are  as  defined  for  aircraft. 

Test  Inventory  is  the  total  number  of  items  under  test. 

(b)  Failure  rate  (\). 

For  aircraft  and  other  equipment  with  exponential  failure 
distributions,  the  failure  rate  usually  is  expressed  as: 


MTBF 

where  the  preceding  definitions  for  calculating  MTBF  are  applicable. 

(c)  Total  Maintenance  Actions/lOOO  Flight  Hours  (D056B55271. 

(Total  Quantity  of  Maintenance  Actions)  (1000)  Special  Inventory 
Flight  Hours  Test  Inventory 

1.  Total  maintenance  actions  are  accumulated  in  accord- 
ance with  para.  4-4a(l)(f).  This  rate  can  also  be  expressed  as  "Failure 
Occurrences/lOOO  Flight  Hours"  by  applying  the  criteria  of  para.  4-4(a)(l)(d)  or 
as  "Other  Malfunction  Occurrences/lOOO  Flight  Hours"  by  applying  the  criteria 
of  para.  4-4a(l)(e).  Each  of  these  parameters  may  require  assessment, 
depending  on  the  type  of  Information  required  to  evaluate  aircraft 
characteristics. 

2.  Definitions  for  data  elements  other  than  failure  occur- 
rences are  provided  under  para.  4-4a(2)(a). 

(d)  Aborts/lOOO  Flight  Hours  (D056B5527). 

Aborts  are  divided  into  two  categories:  before  flight  and 
in-flif^t.  Each  of  these  is  expressed  as  a rate  computation  per  1000  flight  hours 
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that  are  based  on  reported  actions  from  the  on-equlpment  maintenance 
environment.  These  rates  are  calculated  as  follows: 


Before-Flight  Aborts  (BFA). 


Rate  = 


/Aborts  Accumulated  for  \ 
Iwhen  Discovered  Code  A/ 


Flight  Hours 


(1000)  Special  Inventory 
Test  Inventory 


2.  In-Fllght  Aborts  (IFA). 


/Aborts  Accumulated  for  \ 

_ \When  Discovered  Code  C/(1000)  Special  Inventory 
" Fll^t  Hours  ^ Test  Inventory 


3.  When  discovered  codes  are  provided  in  appendix  4-2A. 
Other  terms  have  already  been  defined. 


(e)  Aborts. 

1.  Total  Aborts/lOOO  Sorties  Flown  (DO5fiB5015). 


Rate  = - 


/Aborts  Accumulated  for  When) 
V Discovered  Codes  A and  C / 


Sorties  Flown 


1000 


where: 


Sorties  are  the  sum  of  successful  missions  and  In-flight  aborts  for  some 
specific  time  period.  Another  way  of  expressing  this  term  is  in  aircraft 
takeoffs  over  the  time  span  for  which  the  aborts  were  accumulated. 
(NOTE:  Care  should  be  taken  In  the  use  of  the  above  equation.  The 
numerator  Includes  both  before-flight  and  in-flight  aborts.  The  denomi- 
nator reflects  only  aircraft  takeoffs  and  not  total  attempted  missions. 
Therefore,  significant  changes  in  the  number  of  before  flight  aborts  may 
cause  extreme  variations  from  rates  computed  as  described  below.) 
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2.  Alternate  Abort  Rates. 


Although  not  used  in  the  D056  data  system,  a more  con- 
ventional method  of  expressing  abort  rates  is  based  upon  the  Maintenance  Data 
Collection  System.  The  equations  for  these  rates  are; 


a.  Before-Flight  Aborts. 


Rate  = 


Before-Flight  Aborts 


(Sorties  Flown)  * (Before-Flight  Aborts) 


In-Flight  Aborts. 


„ ^ _ In-Flight  Aborts 

" Sorties  Flown 


c.  Total  Aborts. 


Rate  = 


'In-Flight  Aborts)  (Before-Flight  Aborts) 
(Sorties  Flown)  i (Before-Flight  Aborts) 


(f)  Failure  Occurrences/lOOO  Operating  Hours. 

. _ (Quantity  of  Failure  Occurrences)  (1000)  Special  Inventory 

Operating  Time  ‘ Test  Inventory 

This  parameter  is  generally  associated  with  equipment  other  than  aero- 
space vehicles,  e.g. , AGE,  CEM  equipment,  trainers,  and  simulators. 
Failure  occurrences  are  accumulated  In  accordance  with  para.  4-4a(l)(d). 
D056  products  for  CEM,  simulators  and  trainers,  ground  and  air  laimched 
missiles,  and  weapons  use  possessed  time  for  operating  time. 

Operating  Time  is  the  cumulative  time  that  an  item  has  been  in  operation, 
based  on  ETI  readings  or  historical  records.  NOTE:  If  specific  ETI 
readings  are  available  for  the  special  configured  items,  the  inventory 
ratio  need  not  be  used. 

(g)  Percent  Failures  by  When  Discovered  Code  (D056B5527). 

1.  Before  Flight. 


Percent  Failures  = 


/Failure  Occurrences  Accumulated  for) 
\ When  Discovered  Codes  A &■  B ' 
Failure  Occurrences 


X 100 
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2.  In  Flight. 


Percent  Failures 


/Failure  Occurrences  Accumulated  for 
' When  Discovered  Codes  C & D 
Failure  Occurrences 


3.  Between  Flights. 


Percent  Failures 


/ Failure  Occurrences  Accumulated  for  \ 
vWhen  Discovered  Codes  E,  F,  G,  H,  J.N.  V.  and  3/^. 
Failure  Occurrences 


4.  During  Inspection. 


Percent  Failures 


/ Failure  Occurrences  Accumulated  \ 
for  When  Discovered  1 

^Codes  K.M.P.Q.R.T.U.W.X.Z.2.  & 4/.. 
Failure  Occurences 


Failure  occurrences  are  defined  in  para.  4-4a(l)(d). 
When  discovered  codes  are  presented  in  appendix  4-2A.  Failure  occurrences 
are  derived  from  on-equipment  actions. 

(h)  Reliability  (Percent). 

Mission  Reliability  = 


Before-Flight  Aborts  ^ In-Flight  Aborts 
Sorties  + Before-Flight  ATOrts 


2.  Before-Flight  Reliability  = 


Before-Flight  Aborts 

” Sorties  Flown  ♦ Before-Flight  Aborts 


X 100 


3.  In-Flight  Reliability  = 


1 


In-Flight  Aborts 
Sorties  Flown 


X 100 
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where: 


Before-Flight  Aborts  are  defined  In  para.  4-4a(l)(il 
In-Flight  Aborts  are  defined  in  para.  4-4a(l)(j) 

Sorties  are  defined  in  para.  4-4a(2)(e). 
b.  Maintainability  Parameters. 

The  equations  for  calculating  the  maintainability  parameters  listed  in 
table  4-2c  are  presented  below.  Again,  these  are  point  estimates  of  each 
parameter.  Applicable  statistical  techniques  are  discussed  in  subsection  4-4e. 

(1)  Criteria  and  Ground  Rules. 

When  evaluating  the  maintainability  parameters  listed  in 
table  4-2c,  the  following  ground  rules  apply. 

(a)  Man-hours  expended  on  TCTOs  and  ECPs  will  be  reported 
and  included  in  the  computation  of  man-hours  per  flying  hour. 

(b)  Personnel  dispatched  to  observe  maintenance  for  training 
purposes  only  will  not  be  identified  on  AFSC  form  258/AFTO  form  349  as  a part 
of  the  crew.  Personnel  in  a training  status  that  are  dispatched  to  perform  the 
maintenance  task  as  a member  of  the  repair  crew  will  be  identified  on  AFSC 
form  258/AFTO  form  349,  and  their  man-hour  expenditures  documented 
accordingly. 


(c)  All  man-hours  expended  on  deferred  maintenance  will  be 
documented  except  those  expended  by  the  contractor  to  bring  the  end  item  to  the 
contract-specified  test  configuration. 

(d)  Man-hours  spent  researching  manuals,  technical  orders, 
etc. , will  be  reported  if  directly  related  to  a specific  maintenance  task. 

(e)  Man-hours  spent  accumulating  tools  necessary  for  a mainte- 
nance task  will  be  reported. 

(f)  Man-hours  expended  taxiing  or  towing  an  aircraft  incident  to 
a maintenance  task  will  be  reported. 

(g)  Man-hours  expended  in  transportation  to  and  from  the  job, 
not  to  exceed  0. 5 hour  round  trip  per  man;  delays  at  the  job,  not  to  exceed 

15  minutes  per  man;  the  actual  repair;  cleanvtp  directly  related  to  the  task;  and 
required  form  entries  will  be  reported. 

(h)  Maintenance  debriefing  man-hours  will  not  be  reported 
unless  done  at  the  aircraft  as  part  of  the  troubleshooting  or  analysis/trouble- 
shooting portion  of  the  task. 
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(i)  Man-hours  expended  In  cannibalization  will  be  reported. 

(j)  Man-hours  expended  solely  for  preparing  for  or  standing  by 
for  static  display  will  not  be  reported.  Man-hours  expended  in  inspections  and 
repairs  as  a result  of  aerial  demonstrations  will  be  reported. 

(k)  Man-hours  expended  in  direct  support  of  development,  test, 
and  evaluation  (DT&E)  tasks  (towing  aircraft  to  evaluate  a tow  bar,  repair  of 
test  instrumentation,  etc.)  will  not  be  used  for  evaluations  of  maintainability. 

(l)  If  an  item  is  damaged  or  maintenance  errors  induced  by 
item  design  complexity,  by  poor  design  practice,  or  by  following  improper  pro- 
cedures that  allow  improper  maintenance  (e.g. , interchangeability  of  connec- 
tors) without  proper  caution  in  the  technical  manuals,  the  maintenance  times 
will  be  chargeable.  Even  when  corrective  action  concerning  the  improper  pro- 
cedures or  deficiencies  has  been  completed,  the  maintenance  times  (man-hours) 
will  not  be  deleted. 

(m)  If  personnel  are  required  on  an  intermittent  or  sequenced 
basis,  the  man-hours  assessed  against  the  maintenance  task  will  include  the 
required  standby  time  only  if  that  time  is  of  a type  or  duration  that  prevents 
standby  personnel  from  performing  other  productive  tasks. 

(n)  Man-hours  are  the  sum  of  productive  direct  man-hours 
reported  by  work  unit  code  or  TCTO  data  code.  Various  categories  of  man- 
hours are  identified  below.  (NOTE : Type  maintenance  codes  shown  below  apply 
to  the  D056B5006  reports  which  portray  man-hour  expenditures  but  not  man- 
hours per  flight  hour  data.) 

Scheduled.  Scheduled  man-hours  are  those  spent  on 
scheduled  maintenance  and  reported  by  the  following  t3’pe  maintenance  codes  as 
listed  in  AFM  300-4,  Volume  XI: 

a.  For  aircraft  (including  installed  engines),  drones, 
and  related  mobile  training  sets  and  resident  training  equipment: 


je  Maint. 


Description 


Service 

Basic  postflight  or  thru  flight 
Inspection 

Preflight  inspection 

Hourly  postflight  or  minor  inspection 

Home  station  check 

Scheduled  calibration  of  equipment  or 
components 

Interior  refurbishment 
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Type  Matnt.  Description 

P Periodic,  phased,  or  major 

inspection 

Q Forward  support  spares 

R Depot  maintenance 

T Time  compliance  technical  order 

For  engine  shop  work: 

Type  Maint.  Description 

A Gas  turbine  engine  scheduled 

inspection 

C Gas  turbine  engine  buildup 

D Gas  turbine  engine  teardown 

H Reciprocating  engine  buildup 

K Reciprocating  engine  teardown  and 

preparation  for  shipment 

Q Forward  support  spares  (MAC  only) 

R Depot  maintenance 

T Time  compliance  technical  order 

£.  For  common  AGE: 

Type  Maint.  Description 

A Service 

D Scheduled  inspection 

J Calibration  of  operational  equipment 

p Periodic  or  phased  inspection 

Q Forward  support  spares 

R Depot  maintenance 

T Time  compliance  technical  order 

d.  For  air  launched  missiles,  related  AGE,  and 

training  equipment: 

Type  Maint.  Description 

A 


C 


Service 

Basic  postflight 


in 

^ ■ rf 

Type  Maint. 

1 

Description  i 

D 

Preflight  or  scheduled  inspection 

E 

Hourly  postflight 

J 

Calibration  of  operational  equipment 

P 

Periodic  or  phased  inspection 

R 

Depot  maintenance 

T 

Time  compliance  technical  order 

e.  For  ground  launched  missiles,  related  AGE,  CEM, 

and  training  equipment: 

Type  Maint. 

Description 

A 

Service 

D 

Scheduled  inspection 

F 

Scheduled  ground  launched  missile 
maintenance 

J 

Calibration  of  operational  equipment 

P 

Periodic  or  phased  inspection  ^ 

R 

Depot  maintenance 

T 

Time  compliance  technical  order 

f.  For  Class  I trainers: 

Type  Maint. 

Description  , 

A 

Service 

D 

Scheduled  Inspection 

J 

Calibration  of  operational  equipment 

P 

Periodic  or  phased  inspection 

R 

Depot  maintenance 

T 

Time  compliance  technical  order  | 

g.  For  ground  CEM  equipment:  j 

Type  Maint, 

Description 

A 

Service  i 

D 

Scheduled  inspection  daily/shlft 

F 

Scheduled  inspection  phased/periodic 
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Twe  Maint. 


Description 


Calibration  of  operational  equipment 
Scheduled  maintenance 
Depot  maintenance 
Time  compliance  technical  order 


h.  For  munitions: 


Type  Maint. 


Description 

Scheduled  Maintenance 
Calibration  of  operational  equipment 
Depot  maintenance 
Time  compliance  technical  order 


2.  Unscheduled  — These  are  the  man-hours  spent  as 
unscheduled  maintenance  and  reported  by  the  following  type  maintenance  codes 
as  listed  In  AFM  300-4,  Volume  XL  For  the  equipment  listed  above,  the 
following  codes  as  they  apply  are  considered  to  be  unscheduled  maintenance; 


je  Maint. 


Description 


B Unscheduled  maintenance  (all) 

E Unscheduled  test  cell  operation 

(engines  only) 

H Emergency  on-slte  (CEM) 

L Reciprocating  engine  Intermediate 

maintenance  (engines  only) 

S Special  Inspection  (all) 

W Minor  maintenance  on  removed 

engines  (engines  only) 

Y Transient  aircraft  or  transient  In- 

shop  engine  maintenance 

3.  Shop.  These  are  "off  equipment"  man-hours  expended 
by  shop  maintenance  personnel  In  checking/repairing  Items  removed  from  the 
end  article  and  which  are  charged  to  each  work  unit  code.  (NOTE:  D056B5006 
provides  man-hours  and  man-hour/fllght  hour  data  on  selected  aircraft  only. 
When  available  It  Is  the  best  D056  source  for  MH/FH  data.  Scheduled  and 
unscheduled  man-hours  are  broken  out  by  system.  Summary  man-hour  data  are 
also  shown  for  support  general  WUCs  and  for  TCTOs.  The  Weapon  Subtotal  line 
contains  system  man-hour  data  only.  The  We-'.pon  Grand  Total  line  Is  the  sum 
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! of  the  support  general  man-hours,  TCTO  man-hours,  and  weapon  subtotal 

, man-hours.  The  flying  time  shown  at  the  end  of  the  report  divided  Into  the  last 

Weapon  Ground  Total  entry  equals  the  sum  of  the  man-hour  per  flying  hour 
number  in  the  "Org"  and  "Field"  columns.  The  D056B500fi  "shop"  entry  will 
include  programmed  depot  maintenance  man-hours  if  any  have  been  expended. 
Depot  component  overhaul  data  are  not  Included  In  the  "shop"  values.  Man-hour 
figures  in  the  scheduled  and  unscheduled  columns  are  on-equipment  man-hours 
only.  In-shop  engine  man-hours  are  not  Included  in  these  two  columns  or  in  the 
"Shop"  column.  The  "Shop"  column  Includes  bench  check  serviceable  man-hours 
(action  taken  code  B or  J,  with  how  malfunctioned  code  799).  This  column  does 
not  relate  directly  to  the  Shop  Action  Units  column,  which  does  not  Include  bench 
check  serviceable  actions,  although  programmed  depot  maintenance  actions  are 
Included.  Use  DO56B5025  man-hour  per  flying  hour  data  for  comparison  with 
operational  craft  on  a fleet-wide  basis. 


(o)  All  man-hours  documented  in  WUCs  OIXXX  through  09XXX 
in  accordance  with  the  above  criteria  will  generally  be  used  to  compute  support 
general  man-hours,  and  WUCs  IIXXX  through  99XXX  will  be  used  for  corrective 
man-hours.  Type  maintenance  code  T and  equipment  class  codes  must  be  used 
to  obtain  TCTO  man-hour  expenditures.  (NOTE:  D05fi  products  usually  include 
support  general  codes  in  the  03XXX  and  04XXX  categories  only.  Although  the 
D056B5527  includes  man-hour  per  flight  hour  figures,  no  support  general  data 
are  Included.  D056  man-hours  data  must  be  used  with  caution  since  all  support 
general  codes  may  not  be  included.)  Man-hour  expenditures  as  outlined  above 
will  be  reported  to  the  nearest  0. 1 man-hour.  AFTO  form  349  start/stop  times 
will  be  recorded  to  the  nearest  5 minutes. 


(p)  Mean  active  downtime  is  that  portion  of  test  inventory 
possessed  hours  expended  in  active  maintenance.  Inspection,  and  corrective 
maintenance.  It  does  not  include  servicing,  loading,  standby  alert,  flying,  or 
dead  shift  time. 

(q)  Quick  turnaround  time  will  have  different  criteria  based  on 
the  weapon  system  and  conflgv ration  to  be  generated.  In  general  it  is  the  total 
elapsed  clock  hours  required  between  missions,  under  ideal  conditions,  to  pre- 
pare an  aircraft  for  immediate  relaunch,  including  the  loading  of  expendables 
(fuel,  ammunition,  bombs,  etc.).  All  personnel,  GdE,  and  expendables  are 
pre-posltloned,  with  time  usually  starting  at  engine  shutdown  and  ending  with 
aircrew  acceptance  and  engine  start  and  ready-to-taxl  of  the  turned  aircraft. 

(r)  Dead  shift  time  (e.  g. , the  third  shift  in  a two-shift  operation) 
is  counted  for  turnaround  time,  but  not  for  mean  active  downtime  or  quick  turn- 
around time. 


(s)  Mean  man-hours  to  repair  (MMTR)  is  based  on  man-hours 
required  to  accumulate  technical  data,  set  up  test  equipment,  perform  and 
analyze  results  of  troubleshooting  tests  and  procedures,  isolate  the  failed 
component,  obtain  a replacement  (including  delivery  and  administrative  delays 
up  to  15  minutes  per  man),  perform  the  repair  and  verification,  and  perform 
cleanup  and  put-away  directly  associated  with  the  specific  component/ 
equipment  repaired.  Similar  criteria  will  bo  applied  to  components  for  which 
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reported  malfunctions  could  not  be  duplicated.  The  times  will  be  reported  to 
the  nearest  0. 1 man-hour. 

(t)  Mean  time  between  maintenance  (or  on-equlpment  maintenance 
actions)  Is  based  on  how  malfunctioned  codes  (types  1,  2,  and  6)  and  action  taken 
codes  E,  F,  G,  11,  J,  K,  L,  P,  R,  S,  V,  X,  and  Z (DOSGBSOOfi) . This 
algorithm  Is  also  used  for  accumulating  total  occurrences.  Excluded  from  both 
are  cannibalization,  off-equlpment  repair,  NUTS  action.  Installation  (action 
taken  code  Q),  troubleshooting  (action  taken  code  X),  and  all  support  general 
work. 


(u)  Turnaround  time  Includes  the  time  needed  for  active  mainte- 
nance, supply,  administrative  delay,  and  Inactive  maintenance  due  to  personnel 
nonavailability  (dead  shift).  It  also  Includes  that  time  for  which  there  Is  no 
operational  requirement  for  the  aircraft. 

(v-)  Not  Operationally  Ready,  Maintenance  (NORM)  is  applicable 
to  all  types  of  equipment  (aircraft,  missiles,  CEM,  trainers,  etc.).  For 
aerospace  vehicles  and  trainer  equipment,  this  parameter  is  separated  Into  two 
categories:  groimded  and  flyable.  Within  each  category  a further  breakdown  is 
scheduled  and  unscheduled  maintenance.  For  CEM  equipment,  reduced 
capability  can  be  indicated.  The  criteria  of  AFR  fi5-110  are  applicable.  For 
other  types  of  equipment  such  as  AGE  and  PME,  the  breakdown  is  limited  to 
scheduled  and  unscheduled  maintenance.  Unscheduled  maintenance  man-hours 
are  accumulated  from  the  type  of  maintenance  codes  listed  in  para.4-4b(l)(n)2. 
Scheduled  maintenance  man-hours  are  accumulated  from  the  type  of  mainte- 
nance codes  provided  in  para.  4-4b(l)  (n)^. 

(w)  Not  Repairable  This  Station  (NRTS)  is  assoeiated  with  off- 
equipment  maintenance  actions  at  the  base  level,  and  Is  an  indication  of  the 
repair  capability  at  that  level.  Maintenance  man-hours  are  expended  in  making 
this  determination. 

(2)  Equations. 

(a)  Maintenance  Man-Hours  per  Flight  Hour  (MH/FH) . 

The  primary  source  for  man-hour  per  flight-hour  data  Is 
DO56B.‘i025.  D056Br)527,  "Maintainability  Reliability  Summary",  also  lists  man- 
hour per  flying  hour  data.  Care  should  be  taken  In  selecting  either  source. 

1.  Maintenance  Man-Hours  per  Flight  tiour  (MH/FU) 
(D056B5527).  This  product  Is  available  for  aircraft  only,  and  provides  Infor- 
matlon  for  two-,  three-,  or  five-position  work  unit  codes.  There  is  no  option 
for  a weapon  system  level  report. 

a.  On-Equlpment  (MH/FB). 


On-Equlpment  Man-Hours  Aircraft  Inventory 
Fl'ght  Hours  Special  Inventory 


where: 


On-Equlpment  Man-Hours  ts  the  sum  of  on-equlpment  labor  expended, 
except  support  general. 

Flleht  Hours  Is  the  accumulation  of  total  flying  hours  for  all  test  aircraft 
over  the  same  time  period  for  which  on-equlpment  man-hours  were 
accumulated. 

Special  Inventory  and  Aircraft  InventoiT  are  as  defined  In  para.  4-4a(2)(a)l. 
b.  Off-Equtpment  MH/FH. 


Hate 


Off-Equipment  Man-Hours  Aircraft  Inventory 
Flight  Hours  ^ Special  Inventory 


where 


Off-Equipment  Man-Hours  (shop  hours)  are  the  sum  of  all  off-equlpment 
labor  expended  In  WUC  series  IIXXX  through  99XXX.  Excluded  are 
support  general,  depot,  and  Items  withdrawn  from  supply  (when  discovered 
code  Y)  actions. 


c.  Total  MH/FH. 


Hate 


Total  Man-Hours  Alrci-aft  Inventory 
Flight  Hours  ^ Special  Inventory 


where: 

Total  Man-Hours  are  the  sum  of  all  on-equlpment  and  off-equlpment 
maintenance  man-hours  as  defined  In  para.  4-4b(2)(a)l.. 

2.  Maintenance  Man-Hour  Per  Flight  Hour  (MIl/FH) 

(DO56B5025). 

a.  Scheduled  MIl/FH. 


Hate 


Scheduled  Man-Hours  Aircraft  Inventory 
Flight  Hours  ^ Special  Inventory 


where: 

Scheduled  Man-Hours  are  all  scheduled  man-hours  by  system  (other  than 
support  general  and  TCTO)  baaed  on  type  maintenance  codes  A,  C,  D,  E, 
H,  J,  M,  P,  Q,  and  H.  (NOTE:  This  D05R  product  applies  to  selected 
aircraft  only.)  See  paragraph  4-4b(l)(n)l  for  meaning  of  type  maintenance 
codes. 
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Flight  Hours  are  defined  In  paragraph  4-4b(2)(a)l^,  and  are  shown  at  the 
end  of  the  DOSfi  protluct. 

Aircraft  Inventory  and  Special  Inventory  are  as  defined  In  para- 
graph 4-4a(2>(a)U 

h.  Unscheduled  Mll/FH. 


Itate 


Unscheduled  Man-Hours  Aircraft  Inventory 
Flight  Hours  Special  Inventory 


where 

Unscheduled  Man-Hours  are  all  man-hours  by  system  (other  than  support 
general  and  TCTO)  as  defined  by  use  of  type  maintenance  codes  B,  S,  and 
Y.  See  paragraph  b-4b(l)(n)2  for  meaning  of  type  maintenance  codes. 

Flight  Hours  are  as  defined  In  paragraph  4-4b(2)  (a)  1^,  and  are  shown  at  the 
end  of  the  product. 

Aircraft  Inventory  and  Special  Inventory  are  as  defined  In  para- 
graph 4-4a(2)(a)U 

c.  Weapon  Grand  Total  Mll/FH. 

. Weapon  Grand  Total  Man-Hours  Aircraft  Inventory 
^ ^ Flight  Hours  ^ Special  Inventory 

where 

Weapon  Grand  Total  Man-Hours  are  the  sum  of  work  unit  code  03XXX,  and 
04XXX  support  general,  work  unit  code  11XXX-99XXX  system  subtotal, 
and  aircraft  TCTO,  commodity  TCTO,  and  engine  TCTO  subtotals. 

Flight  Hours  are  as  defined  In  paragraph  4-4b(2)  (a)  1^,  and  are  shown  at  the 
end  of  the  product. 

Aircraft  Inventory  and  Special  Inventory  are  as  defined  In  para- 
graph 4-4a(2>(a)l^. 

NOTE:  This  product  lists  the  MH/FH  figures  at  each  of  the  three  levels  of 
maintenance:  organizational,  field,  and  depot, 

(b)  Maintenance  Man-Hours  per  Operating  Hour  (MIl/OHl. 

1^.  On-Equlpment  MH/OH. 


Itate 


On-Equlprr  vnt  Man-Hours  Test  Inventory 

Operating  Time  ^ Special  Inventory 
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On-Equipment  Man-Ht)urs  (except  1X^56)  are  the  sum  of  on-cquipment  labor 
expended  for  all  support  general  WUCs  and  all  on-i'quipment  labor 
expended  on  WUCs  requiring  preventive  and  corrective  maintenance 
actions. 

Operating  Time.  Special  Inventory  and  Test  Inventory  are  as  ..efined  in 
para.  4-4a(2)(a>2. 

2.  Off-Equipment  MH/OH. 

Off-Equipment  Man-Hours  Test  Inventory 
Operating  Time  ' Sjiecial  Inventory 


where: 

Off-Equipment  Man-Hours  (shop  hours),  except  for  DOfifi,  are  the  sum  of 
all  off-equipment  labor  expended  for  all  support  general  WUCs  and  all  off- 
equlpment  labor  expended  on  WUCs  requiring  corrective  maintenance 
actions. 


3.  Total  MH/OH. 


Total  Manhours  _ Test  Inventory 
Operating  Time  ^ Special  Inventory 


where: 

Total  Man-Hours  (except  0056)  are  the  sum  of  all  on  equipment  and  off- 
equipment  maintenance  man-hours  as  defined  in  para.  4-4b(2)(a)J|.  and 
4-4b(2)(a)2. 


4.  The  above  parameters  are  usually  applicable  to  equip- 
ment other  than  aerospace  Vehicles.  AGE,  ground  CEM,  trainers,  and  simu- 
lators fall  into  this  category. 

(c)  Mean  Man-Hours  to  Repair. 

Total  Corrective  Maintenance  Man-Hours 
MMTR  - Total  Corrective  Maintenance  Occurrenees 


where: 

Total  Corrective  Maintenance  Man-Hours  are  the  sum  of  all  off-  and  -on 
equipment  maintenance  man-hours  expended  on  WUCs  (IIXXX  through 
99XXX)  requiring  corrective  maintenance  actions. 


Total  Corrective  Maintenance  Occurrences  are  the  sum  of  the  unit  count 
for  all  type  1 and  2 how  malfunctioned  codes  in  combination  with  action 
taken  codes  A,  K,  (I,  K,  L,  P,  U,  V,  and  Z. 

NOTl'  1:  These  definitions  are  applicable  to  all  equipment, 
subsystems,  and  systems. 

NOTK  2;  Data  systems  as  they  currently  exist  do  not 
accumulate  clock  hours  as  part  of  the  summary  of  information  from  AFTO 
form  349,  An  estimate  of  hfl  TU  can  be  obtained  by  dlvldlnR  MMTIt  by  the 
averape  number  of  personnel  utilized  In  performinp  the  corrective  maintenance 
tasks.  If  possible,  an  automated  propram  to  calculate  MTTlt  should  be 
developed.  However,  a manual  summary  of  elapsed  clock  hours  can  be  obtained 
from  the  349  forms  by  test  personnel.  Then: 

Total  Corrective  Maintenance  Clock  Hours 
' Total  Corrective  Maintenance  Occurrences 


(dl  Mean  Time  Between  Maintenance  (Actions),  >frPM. 

((Operating  Tlme)(ITse  Factor)  ((^PA)  ^ Special  Inventory 

(Quantity  of  Maintenance  Occui'rences  ‘ Test  Inventory 


where: 

Quantity  of  Maintenance  Occurrences  Is  the  sum  of  the  on-tHiuipment  unit 
count  for  all  how  malfunctioned  codes  (tj-pes  1,  2,  and  G)  In  combination 
with  action  taken  codes  E,  F,  G,  11,  J,  K,  I>,  P,  H,  S,  X,  anti  Z 
durinp  the  same  time  period  covered  by  the  opci-atinp  time,  with  the 
alnnc  "tipe  maintenance  code"  criteria  applied. 

Operatinp  Time  is  the  accumulation  of  flyinp  time  or  operatlnp  time  from 
historical  records  or  ETls  for  items  so  equipped. 

Use  Factor,  QPA,  Special  Inventory  and  Test  Inventory  are  as  defined 
in  para.  4-4a(2>(a)2. 

NOTE  1:  There  la  no  satisfactory  1X456  source  of  off- 
iK^uipment  maintenance  actions  that  would  be  comparable  to  shop  (off-oquipmenti 
man-hours  as  used  in  the  IX456B5006,  The  shop  action  units  used  in  the 
r)056P5006  do  not  Include  components  that  are  ^nch  checked  and  require  no 
repair  (action  taken  codes  B,  J,  and  X),  In-shop  support  peneral  work,  or  work 
associated  with  action  taken  codes  C,  D,  M,  and  N.  The  IX456B5505,  Part  11  - 
shop  actions.  Includes  scrvlceables  (action  taken  codes  B and  and  delay 
codes  C,  n,  M,  and  N,  but  omits  action  taken  code  X events  and  In-shop  svipport 
general  activity.  Further,  the  DO56B5505  is  prodviced  only  when  a work  unit 
coded  item  exceeds  its  asslpned  failure  limit  or  drops  below  the  asslRned  mini- 
mum acceptable  reliability  factor.  While  this  product  may  be  useful  for  WUC 
studies.  It  would  not  be  a practlal  source  of  data  for  systems  or  mission, 
desipn  and  series  (MHS)  purposes. 
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NOTK  2:  AUhoujjh  th»'  proiUu'ts  tio  not  proviso  M'l'HM 

8ohodulpd  and  ^^VUM  unaoKodnU'd  v«lut*8,  thoso  data  wuld  Ih'  obtained  hy 
applyln){  tho  orltorla  in  para^:rapha  4— 4b(l>(nU  for  sohoduioii  and  para- 
(;raph  4-4b(li(n)2  for  iinsohodulrd  oatom'irlos. 

(oi  ^an  Aotlvo  lX>\vn  Ttmo  (MAlvn. 

Total  Aotive  IXwnttmo  Hours 
i*o88paaoii  Hours 


whoro: 


Total  Acttvo  IVnvntiwo  Hours  eomprlsr  all  sohoduloil  and  iinsi'ht'ttido<i 
on-tHiidpm«'nt  maintonanro  time'  and  Inspe'otlons.  All  time'  Is  e'xprt'sse'd 
In  oloi'k  hours. 

(f>  Not  e>pe'ratlonnlly  Ht'atly.  Malnte'nanoe*  (NOUMI. 

Ni'UM  t'lU'ompasst's  twM  oate'p'rlos:  uroumlod  ami  flyable'. 
Within  t'arh  e'ate'Ki'ry  a feirthe'r  brt'akil('\vn  Is  srht'dule'el  and  unse'ht'ihde'il  nealntt'- 
nanct'.  NOUM  rate's  I'an  Ih'  Ivsise'd  on  t'Uht'r  all  juvunde'el  or  all  nix'umle'el  anel 
flyable'  hours.  The  followlnj;  formulas  are  applU'able: 

1.  NfUM-C.  Hate. 


Nl'UM-l5  Hate 


Ile'tirs 

Alre'raft  lle'urs  I'e'sse'sse'e^ 


where: 


NOHM-(.l  lle'urs  are  the  smn  of  N(.''HM-t'i  unsehoeluleel  anel  sehedvded  hovers 
for  the  test  Inventory  over  the  time  perle'el  Ivln^  evahiate'ei. 

Alreraft  lU'virs  I'e'ssesseel  Is  the'  sum  e'f  the  total  eloek  heuirs  aeoumulateil 
for  the  test  Inventory  elurlnK  the  time  perle'el  asse'e'late'el  with  the* 
evaluation. 


2.  Total  NOHM  Hate. 


Total  NOHM  Kate 


Total  NtMtM  Hours 
.Alreraft  lU'urs  I'e'ssosse'el 


where: 


Total  NOHM  Ib'urs  are  the  sum  of  NOHM-tl  unseheehded  heuirs,  Nf^HM-O 
schi'duled  he'urs,  and  all  NOHM  flyable  (NOHM-V'l  hours  for  the  test 
Inve'ntory  over  the  time  period  under  evaluatle'n. 


3, 

I'aloiilatt'il  as  follows 


Ki'r  oquipmont  othor  than  airoraft,  a Nt>UM  lato  Is 


NdKM  Itato 


NOUM  I louts 
Total  Hours  I’l'ssossoil 


whoro; 


Nl^HM  Hours  aro  tho  svnu  of  all  sohoduloil  anil  unsohoiluloil  NT>HM  hours 
for  tho  tost  invontory  o\i'r  tho  timo  porioii  of  tho  I'valuation, 

Total  Hours  Hossossoil  is  tho  sum  of  tho  total  olook  hours  aooumulatoil 
for  tho  tost  invontory  during  tho  timo  poriod  undor  ovaluation. 

(Hi  Not  Uopa i ra bio  This  Station  (NUTS) . 


, total  NUlh  Man-Hours 

MtlJ'  Indox  -..f.— r — 

Ofl-Kqmpmont  Man-Hours 


whoro ; 


Total  N'HTS  Man-Hours  aro  tho  sum  of  all  off-oquipmont  nvan-hours 
aooumulatoil  for  notion  takon  oodos  1 thixnigh  lb 

t)ff-Kquipmont  Mnii-Hoiirs  aro  as  doiinod  in  para.  I-  lb(Jl  (bl2. 

(hi  Huilt-ln  Tost  (HIT)  Kffootiv onoss. 

Man.v  now  ond  itoms  aro  boinj;  dosii;nod  with  built-in 
tost  oapabilitios  to  dotoot  and  isolato  malfunv'tions  to  subsystoms  and/or  lino 
roplaooablo  units  (LltUs)  within  tho  ond  Itom.  Tho  purposo  of  Hi  r is  to  roduoo 
tho  corrootivo  maintonanoo  timo  roquirod  to  rostoro  tho  ond  itom  to  an  oporatin^ 
oondition.  Howovor,  valuablo  maintonanoo  manhours  aro  oxqH'ndod  if  tho  HU' 
providos  falso  indications.  Tho  two  most  common  faults  aro  that  tho  HI  T falsoly 
indicates  a malfunction,  or  indicates  a malfunction  in  tho  wronii  l.UU.  A meas- 
ure of  tho  adequacy  of  tho  HU'  Is  to  dotormtno  tho  success  ratio  for  this  equip- 
ment. Presently  this  data  must  bo  collootod  manually. 

2.  HIT  Success  Hatio  (Porconty 


Success  Hatio 


Malfunctions  Dotoctod  Isolated  ^ 
Total  Malfunctions  Indicated 


whoro: 


Malfunctions  notootod/lsolatod  aro  tho  sum  of  tho  successful  attempts  of 
tho  HIT  to  dotoot  ''isolate  malfunctions  over  some  specific  time  period. 

Total  Malfunctions  Indicated  aro  tho  sm..  of  all  malfunctions  Indicated  by 
tho  HI  T for  tho  same  timo  poriod. 
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Kaiilt  Ootoctton  Hate  (Percents 


Total  Conflrnunl  KaiUiivs  Potoctod  by  Pi  r 
Total  Corroctlve  Maiatenaiico  Oocm  ronot's 


x 100 


where: 


Total  Corrective  Matatenance  (^ccnirrences  are  the  sum  of  the  unit  count 
for  all  on-equipment  t>pe  1 ami  txqie  2 how  malfunotioneii  codes  in  combi- 
nation with  action  taken  codes  A,  K,  G,  K,  T,  i\  it,  V,  and  Z (see 
appendix  4-2A  for  definitions  of  action  taken  codes!. 

1.  Fault  Isolation  Kate  (I'ercenti. 


Total  Confirmed  l.Kl^  Failures  Petecteci  bv  PI  T 


Total  Confirmed  Failures  lietected  by  PI  T 


X 100 


False  .Marm  Hate  (Percent!. 


Total  Units  With  No  Defect  Found 
I'otal  Failures  Indicated  by  PI  T 


X 100 


where: 


Total  Units  With  No  Defect  Found  are  the  sum  of  the  unit  count  for  all 
PIT-indicated  failures  with  aetlon  taken  code  H,  or  a combination  of 
action  taken  codes  I’  and  H with  action  taken  code  P. 

fi.  There  are  other  categorizations  by  which  PIT  effective- 
ness can  be  measured.  The  important  thing  is  to  have  a system  that  is  automatic 
(computer  operated!,  and  that  will  update  Itself  appropriately  when  a suspected 
failed  component  bench-checks  serviceable,  in  some  cases,  manual  manipula- 
tion of  data  may  be  necessar>’,  as  when  the  beneh  check  is  being  performed  at  a 
depot,  contractor,  or  vendor  facility.  Whenever  possible,  these  inputs  should 
also  be  compviter  processed  by  the  test  team  by  requiring  the  repair  facility  to 
document  the  repair  on  AFTO  form  349  or  AFSC  form  258-4,  Using  the  break- 
down below,  and  by  setting  aside  one  unused  block  on  the  349  or  258/258-4,  PIT 
success  rate  can  l>e  sorted  against  any  series  of  other  entries  on  these  forms 
(WUC  for  example!  and  calculated  accordingly. 

a.  BIT  correctly  detected  and  Isolated  a malfunction. 

b.  BIT  detected  trouble  but  did  not  Isolate. 

c.  BIT  detected  correctly  but  isolated  wrong  l,KU. 

d.  BIT  failed  to  detect  a trouble  that  existed. 

e.  BIT  indicated  a failure  when  none  existed. 

f.  No  BIT  capability  on  system. 
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Actuarial  T.lfe  Expectancj 


The  actuarial  analysis  program  developed  by  the  Air  Force 
Is  a unique  system  correlating  usage  and  failure  data  for  analyzing  equipment 
reliability,  developing  actuarial  life  expectance  factors,  and  forecasting  fail- 
ures. To  apply  these  techniques,  there  must  be  adequate  data  for  the  Item  being 
evaluated.  During  operational  test  and  evaluation  the  two  most  likely  Items  that 
may  be  considered  for  this  type  of  analysis  are  selected  high-value  components, 
aircraft  engines,  and  auxiliary  power  units.  Since  this  Is  a complex  analysis 
effort  and  considerable  data  are  required  to  make  the  analysis  meaningful,  the 
techniques  are  not  Included  In  this  document.  However,  the  techniques  for  per- 
forming the  computations  are  presented  In  TOs  00-25-128  and  00-25-217,  and 
AFM  400-1,  Volume  III,  Part  Three.  Normally,  sufficient  failure  experience 
will  not  be  realized  during  OT&E  to  render  this  type  of  analysis  workable.  How- 
ever, application  of  compatible  data  collection  and  processing  procedures 
should  be  considered. 

(j)  Discrepancies  Per  Scheduled  Inspection  Hate. 


1.  With  the  new  systems  being  Introduced  Into  the  Inventory, 
the  effectiveness  of  the  Inspection  system  must  be  evaluated  to  ensure  that  man- 
hours are  efficiently  utilized  and  not  used  Just  for  Inspection's  sake.  This  can 
be  evaluated  with  respect  to  three  major  areas:  preflight  Inspections,  thru- 
fllght/postflight  Inspections,  and  phase/perlodlc/lsochronal  Inspections. 

2.  Discrepancies  Per  Scheduled  Inspection  Rate  (Prefllght). 


Rate  - 


Total  Number  of  Discrepancies 
Total  Number  of  Inspections 


where : 


Total  Number  of  Discrepancies  is  the  sum  of  the  unit  count  for  all 
discrepancies  with  when  discovered  code  J during  a given  time  period. 

Total  Number  of  Inspections  Is  the  sum  of  the  unit  count  for  all  type 
maintenance  code  D actions  combined  with  WUC  Series  031XX  for  the 
same  period. 

3,  Discrepancies  Per  Scheduled  Inspection  (Thrufllght  and 

Basic  Postflight), 


Rate  - 


Total  Number  of  Discrepancies 
Total  Number  of  Inspections 


where: 


Total  Number  of  Discrepancies  Is  the  sum  of  the  unit  count  for  all 
discrepancies  with  when  discovered  code  H for  a given  time  period. 

Total  Number  of  Inspections  Is  the  sum  of  the  unit  count  for  all  type 
maintenance  code  C actions  combined  wUh  WUC  Series  032XX  for  the 
same  period. 


4 . nlscrepnnctea  Per  Scheduled  Inspection  (\>hnHP.  t‘tc.) , 


. Total  Number  of  Dtsoropnnolos  . 
Total  Number  of  Inapertlons 


where: 


Total  Number  of  ntHorepaiictea  Is  the  sum  of  the  unit  eount  for  all  illa- 
crepanoles  with  when  dlsooveretl  codes  K,  M,  .1,  and  4 for  a nlven  time 
period. 

Total  Number  of  Inspections  la  the  sum  of  the  unit  count  for  all  t\4n' 
maintenance  cixles  K,  II,  and  I*  andWI'Cs  of  Otl.'tXN  and  0H4NX  for  the  same 
period. 

(k)  Percent  Scheduled  Inspection  Man-Hours. 

1.  As  with  (,|>  above,  this  figure  can  be  useil  as  a measure 
of  the  efficiency  of  The  Inspection  concept.  If  an  excessive  portbm  of  man-hovirs 
la  being  expended  on  Inspections  and  no  major  problems  are  being  prevented, 
then  further  refinement  of  the  Inspection  concept  Is  requiretl. 

2.  Percent  Scheduled  Inspection  Man-Hours. 


Percent 


Total  Man-Hours  Schetluled  Maintenance 
Total  Man-llovirs 


where: 

Total  Man-Hours  Scheduled  Maintenance  Is  the  sum  of  all  man-hours 
expended  against  WUt's  which  apply  to  pre-thrufllght  or  basic  postflight 
and  phase,  plus  all  man-hours  documented  against  when  dlscoven'd 
codes  ll,  J,  K,  M,  2,  and  4 for  a given  time  period. 

Total  Man-Hours  Is  as  defined  In  paragraph  4-4b(2)(al_l  for  the  same 
period. 

c.  Availability  Parameters. 

The  formulas  for  developing  the  availability  parameters  listed  In 
table  4-2e  are  presented  In  the  following  paragraphs.  As  previously  Indicated, 
these  equations  provide  point  estimates  for  each  parameter.  Statistical  tech- 
niques are  presented  In  subsection  4-4e. 

(1)  Criteria  and  C round  lUdes. 

The  policies  and  procedures  for  status  reporting  of  selected 
aei'ospace  equipment  are  prendded  In  AV'H  fiS-llO.  This  docviment  Is  further 
amplified  by  ATMs  r.r»-2r>0,  fi.'l-2(ir>,  (55-272,  (55-(5(52,  and  f55-(5(5.*5.  The  criteria 
of  these  manuals  are  applicable  to  availability  evaluations,  (h’cratlonal 
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availability  Is  baaed  on  a possessed  time  of  24  hours  per  day.  Factors  to  be 
considered  In  evaluating  the  operational  availability  parameters  Include: 

(a)  No  more  than  0. 1 hour  will  be  allowed  for  minor  corrective 
maintenance  downtime  durlnj;  prefllKht  and  postfllsht  Inspection  without  calling 
the  aerospace  vehicle  Not  Operationally  Heady  (NOH).  This  criterion  also 
applies  to  any  aerospace  vehicle  otherwise  operationally  ready. 

(b)  If  an  Item  withdrawn  from  stock  Is  considered  InterchanRc- 
ablo  or  a substitute  for  a failed  Item,  the  actual  repair  time  will  be  used  even 
though  the  preferred  Item  may  Involve  a different  NTl'TH. 

(c)  All  time  to  0. 1 hour  will  be  used  to  report  NOHS  time.  All 
NOHS  time  will  be  used  to  determine  operationally  ready  ((Ht)  rates.  NOHS 
time  starts  with  verification  that  a replacement  is  not  available  and  the 
reparable  unit  cannot  be  repaired  locally.  Time  spent  In  verification  will  be 
reported  as  NOHM  time  If  the  NOH  criteria  apply. 

(d)  Time  spent  on  ECPs  and  TCTOs  will  be  reported  If  the  end 
item  Is  rendered  NOH  thereby. 

(e)  Time  spent  investigating  ground  transmitting  facilities 
(data  bank,  OCl,  ILS,  etc.)  will  bo  reported  as  NOH  time  if  other  NOH  criteria 
apply  to  the  aerospace  vehicle  condition  being  reported. 

(f)  Time  spent  researching  manuals,  TOs,  etc.,  if  directly 
related  to  a specific  maintenance  task  shall  be  Included  In  NOH  time  if  other  NOH 
criteria  apply. 


(g)  Time  to  repair  both  primary  (Independent)  failures  and 
secondary  (dependent)  failures  will  cause  the  end  Item  to  be  con- 
sidered Not  Operationally  Heady. 

(h)  All  time  attributable  to  Inadequate  AGK  or  T.O.  deficiencies 
shall  be  Included  In  the  repair  (NOH)  time. 

(l)  Time  expended  In  preflight,  thru  flight,  service,  postflight, 
and  configuring  the  aerospace  vehicle  (Including  ammunition  and  weapons 
loading)  will  not  In  Itself  cause  the  vehicle  to  be  reported  NOH,  but  all  conse- 
quential corrective  actions  will.  If  other  NOH  criteria  apply. 

(j)  Time  expended  while  parts  are  removed  from  the  end  Item 
for  failure  analysis  Is  reported  as  NOH  time  If  other  NOH  criteria  apply. 

(k)  Time  for  repairs  resulting  from  accidents,  incidents,  or 
foreign  object  damage  shall  be  reported  as  NOH  time  If  other  NOH  criteria 
apply. 

(l)  Time  attributed  to  administrative  and  logistics  delays  and 
dead  shift  time  shall  be  included  In  the  NOH  time  If  other  NOH  criteria  apply. 
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(m)  Maintenance  or  operator  Induced  failures,  for  whatever 
reason,  shall  cause  the  end  Item  to  be  reported  NOR  If  the  failure  prevents  the 
Item  from  being  able  to  accomplish  all  missions  for  which  It  Is  equipped. 

(n)  Nonlnstalled  or  Inoperative  subsystems  will  not  affect  end 
Item  status  reporting  If  the  equipment  was  not  operational  Intentionally,  was  not 
caused  by  a failure,  and  does  not  cause  an  alteration  to  scheduled  test/ 
operational  events. 

(o)  To  be  operationally  ready,  the  end  Item  must  be  capable  of 
performing  all  of  Its  assigned  missions  (for  which  It  Is  configured  during 
testing). 


(p)  Failures  of  test  Instrumentation  and  associated  wiring  and 
hardware  will  not  affect  the  reported  status  of  the  aerospace  vehicle. 

(q)  Inflight  reported  discrepancies  that  affect  OR  status  are 
considered  to  have  occurred  at  postfllght  engine  shutdown,  and  NOR  time 
begins  at  that  time. 

(r)  The  following  Is  a condition  status  summary  of  the  report- 
able  not  operationally  ready  classifications  In  order  of  their  reporting 
precedence  (see  AFR  65-110). 

1.  NORM-Ci  Unscheduled 

2.  NORM-C.  Scheduled 

3.  NORS-G 

4.  NORM-F 

5.  NORS-F 
(2)  Equations. 

(a)  Operationally  Ready  (OR)  Rate  (aircraft,  AGM-28,  AGM-69A, 

and  trainers). 


OR  Rate 


Operationally  Ready  Hours  ^ 
Hours  Possessed 


where: 

Operationally  Ready  Hours  are  the  sum  of  unscheduled  NORM,  scheduled 
NORM,  and  NORS  hours,  subtracted  from  the  hours  possessed  for  the 
time  span  of  the  evaluation. 
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fBT 


Hours  Possessed  are  the  product  of  24  hours  per  day  and  the  number  of 
days  In  the  time  span  of  the  evaluation. 

NOTE;  These  values  hold  for  a single  end  Item.  For  more  than  one  end 
Item  under  test  OR  rate  Is: 


OR  Rate 


Total  Operationally  Ready  Hours  ^ 
Total  Hours  Possessed 


where: 

Total  Operationally  Ready  Hours  are  the  sum  of  the  unscheduled  NORM, 
scheduled  NORM,  and  NORS  hours  for  all  end  Items  under  test,  subtracted 
from  the  total  hours  possessed  for  the  time  span  of  the  evaluation. 

Total  Hours  Possessed  are  the  product  of  the  number  of  end  Items  under 
test  24  hours  per  day  and  the  total  number  of  days  In  the  time  span  of  the 
evaluation. 

(b)  Aircraft  Utilization  (AU)  Rate  and  Sortie  Rate. 

1.  AU  Rate  = 


Number  of  Sorties  Flo^ 

(Number  of  Maintenance  l[)ays)iNumber  of  Aircraft) 


where : 

Number  of  Sorties  Flown  Is  the  total  number  of  sorties  flown 
during  the  time  span  of  the  evaluation. 

Number  of  Maintenance  Days  Is  the  total  number  of  workdays  In  the  time 
span  of  the  evaluation. 

2.  Dally  Sortie  Rate  = 

Number  of  Sorties  Flown 
Number  of  Flying  Days 

(c)  Item  On-Line  (Uptime)  Rate  (CEM). 

For  the  purposes  of  availability  evaluation.  Item  on-line 
(uptime)  is  synonymous  with  operational!}'  ready  hours.  Their  primary  differ- 
ence is  that  OR  hours  are  usually  associated  with  aerospace  vehicles  and 
trainer  equipment,  while  on-line  (uptime)  Is  usually  associated  with  ground 
CEM  and  certain  other  end  Items  not  classed  as  aerospace  vehicles.  The 
operational  rate  is  calculated  the  same  as  the  OR  rate  using  on-line  (uptime) 
hours  as  the  numerator  and  hours  possessed  as  the  denominator. 


Operational  Rate 


On-Line  (Uptime)  Hours 
Hours  Possessed 
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where: 

On-Line  (Uptime)  Hours  are  calculated  from  total  maintenance  downtime, 
other  downtime,  and  supply  delay  time,  subtracted  from  the  total  possessed 
hours  for  the  period  as  shown  in  command  CEM  equipment  status  report, 
PCN23115A,  H-fiOOO  PCN  GGIIFODA,  RCS:  HAF-LGY(M>7ir>2.  For 
, trainers/simulators,  only  T1  and  T3  operating  times  are  used  to  express 

trainer  utilization.  T9,  power-on  time.  Is  not  used  to  compute  utilization 
rates.  It  should  also  be  noted  that  all  utilization  time  does  not  nec- 
essarily require  power  on.  T1  Is  used  to  report  Initial  qualification  train- 
ing for  formal  students,  whereas  T3  Is  used  for  familiarization  and  pro- 
ficiency training.  T9  Is  used  to  report  all  power-on  time,  whether  for 
utilization,  maintenance,  and  checkout,  and  generally  Is  read  from  an  FTI. 

(d)  Item  Standby  Time. 

1^.  Item  standby  time  Is  the  fraction  of  the  possessed  time 
that  an  aerospace  vehicle  or  end  Item  Is  considered  ready  to  be  operated  but 
has  not  been  activated  for  operation.  Items  that  fall  Into  this  category  Include, 
but  are  not  limited  to,  AGE  and  CEM. 

(e)  Item  Alert  Time. 

Item  alert  time  Is  the  fraction  of  the  possessed  time  that  an 
aerospace  vehicle  Is  In  an  operating  condition  and  Is  ready  to  perform  its  speci- 
fied mission  when  called  upon  to  so  do.  This  term  may  be  applied  to  items 
other  than  aerospace  vehicles  If  there  is  indeed  an  alert  condition  associated 
with  equipment  operations. 

(f)  Item  Downtime. 

1.  Item  downtime  is  the  fi'action  of  possessed  time  that  an 
end  item  is  not  available  to  perform  Its  mission  because  of  necessary  mainte- 
nance or  supply  actions.  The  sum  of  scheduled,  unscheduled,  and  delay  time 
associated  with  these  actions  comprise  downtime.  Downtime  is  applicable  to  all 
end  items  regardless  of  their  operating  characteristics.  A downtime  rate  can 
be  calculated  using  downtime  as  the  numerator  and  hours  possessed  as  the 
denominator. 


i 

it 


I 


Downtime  Rate 


Downtime  (Hours) 
Hours  Possessed 


I 


This  rate  can  also  be  expressed  in  terms  of  scheduled,  unscheduled,  and  delay  1 

time  by  substituting  In  turn  the  hours  for  each  of  these  elements  in  the  | 

numerator  of  the  above  equation.  I 

2.  For  CEM,  a downtime  condition  may  be  reported  as  I 

Amber  ("A")  or  Red  ("K")  depending  on  how  the  NOR  (llmlted/lnoperatlve)  con-  I 

ditlon  aRected  the  primary  mission  of  the  unit.  The  primary  mission  Is  the  I 

designated  basic  mission  assigned  by  a military  service  to  Its  operational  units  | 

using  the  equipment.  This  mission  should  be  Identified  In  a supplement  to  | 
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AFM  65-2r>5  and/or  In  the  test  plan.  The  Amber  condition  exists  when  the 
equipment  Is  not  OR  but  Is  still  capable  of  providing  some  usable  data.  The  Red 
condition  exists  when  reported  item  Is  unable  to  perform  its  function.  CEM  down- 
time may  be  separately  expressed  as  downtime  Amber,  or  downtime  Red  and 
Amber.  It  should  be  noted  that  downtime  codes  apply  to  active,  standby,  and  back- 
up equipment  or  channels  thereof.  The  assigned  mission  of  standby  or  backup 
equipment  Is  to  be  ready  for  Immediate  recall  or  changeover. 

3.  When  more  than  one  end  item  is  under  test,  an  average 
downtime  for  the  total  test  Inventory  may  be  required.  The  average  downtime 
rate  Is  obtained  by: 


Downtime  Rate  (Avg.) 


Total  Downtime  (Hours) 
Total  Hours  Possessed 


where: 

Total  Downtime  Is  the  sum  of  all  downtime  for  all  of  the  items  under  test 
for  the  time  span  of  the  evaluation. 

Total  Hours  Possessed  are  the  product  of  the  number  of  end  Items  under 
test,  24  hours  per  day,  and  the  total  number  of  days  In  the  time  span  of 
the  evaluation. 

(g)  Not  Operationally  Ready,  Supply  (NORS)  Rate. 

Not  operationally  ready,  supply  comprises  two  categories: 
grounded  and  flyable.  NORS  rates  can  be  based  on  either  all  grounded  or  all 
grounded  and  flyable  hours  combined.  The  following  formulas  apply: 

1.  NORS-G  Rate. 


NORS-G  Rate 


Total  NORS-G  Hours 
Aircraft  Hours  Possessed 


where: 

Total  NORS-G  Hours  is  the  sum  of  all  NORS-G  hours  for  all  the  aircraft 
under  test  over  the  time  span  of  the  evaluation  period. 

Aircraft  Hours  Possessed  Is  defined  In  para.  4-4c(2)(a). 

2.  Total  NORS  Rate. 


Total  NORS  Rate 


Total  NOltS  Hours 
Aircraft  Hours  Possessed 


where: 

Total  NORS  Hours  Is  the  sum  of  all  NORS-G  and  NORS-F  hours  fo.-  all 
aircraft  under  test  over  the  time  span  of  the  evaluation  period. 


3.  For  equipment  other  than  aircraft,  a NOUS  rate  Is 
calculated  as  follows: 


NOitS  Uate 


NOUS  Hours 
Total  Hours  Possessed 


where: 

NOUS  Hours  Is  the  sum  of  all  NOUS  hours  for  th.  test  lnventoi*y  over  the 
time  period  of  the  evaluation. 

Total  Hours  Possessed  Is  defined  In  para.  4-4c(2)(n2. 


a.  For  CF'M,  computed  downtime  rates  by  cause  and 
condition,  and  by  type,  model,  and  series,  are  provided  by  the  Command  CFM 
Equipment  Status  Summary,  UCS:HAF-LriY(M)7ir>2,  I’CN  23115A.  Three  major 
categories  are  listed:  maintenance,  supply,  and  other  (see  appendix  4-50 . 

b.  For  trainers  and  simulators,  UCS:HAF-nFF(M)'fl02, 
Command  and  Trainer  Fqulpment  Inventory,  Utilization  and  Status  Ueports,  or 
UCS:lIAF-nuU(MK.AUj710:i,  Worldwide  Trainer  Equipment  Inventory  Utilization 
and  Status  Uepoi'ts,  provide  similar  Information 

(hi  Other  Parameters. 

MTBF  and  MTTU  are  Included  under  availability  because 
Inherent  availability  is  based  on  these  parameters.  NOUM  rates  Indicate  the 
fraction  of  the  time  spent  maintaining  or  awaiting  maintenance  of  an  equipment 
(delays  Included!.  The  impact  of  MTBF  and  MTTU  on  operational  availability, 
without  delays  Included,  stems  from  the  fact  that  failures,  repairs,  and  mainte- 
nance make  an  Item  unavailable  for  performing  Its  Intended  mission. 

d.  Supportablllty  Parameters. 

Methods  of  calcuUiting  the  qujmtitative  supportablllty  parameters 
listed  in  table  4-2g  are  pwvided  below.  Discussions  concerning  the  quali- 
tative p:irameters  are  delineated  in  section  4-(>.  Again,  the  eqimtions  lor 
quantitative  supportal>ility  parameters  provide  point  estimates  of  these 
parameters.  Statistical  techniques  are  discussed  in  sut>section  4-4e. 


(1!  Criteria  and  Oround  Uules. 

When  evaluating  the  quantitative  supportability  parameters  listed 
In  table  4-2g,  the  following  groundrules  apply. 

(a)  Shop  actions  are  the  off-equlpment  actions  related  to  each 
work  unit  code.  The  three  categories  applicable  to  shop  actions  are  listed 
below,  where: 

U Uepalr  Is  a unit  count  of  the  off-equipment  actions  which 
have  been  assigned  action  taken  codes  A,  F,  G,  K,  U,  or  Z. 


1 
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2.  Comiemnod  Is  a unit  count  of  equipment  actions  which 
have  Ix'cn  assigned  action  taken  code  9. 

NUTS  Is  a unit  count  of  off-equlpment  actions  which  have 
tx'en  assigned  action  taken  codes  1 through  S. 

(b)  The  appropriate  NUTS  code  will  bt>  useil  whenever  a com- 
ponent Is  not  repaired  on  base  by  the  joint  test  force,  even  If  a repair  capability 
Is  programmed. 

(c)  Components  In  awaiting  parts  (AWP)  status  that  are  shipped 

by  the  contractor  bt'fore  expiration  of  the  authorized  holding  times  listed  In 
AKM  Volume  11,  Part  One,  Chapter  10,  will  be  coded  NUTS-S. 

(d)  Uepalr  capability  data  will  be  based  on  expendablllty, 
recoverability,  repalrablllty  category  (EUHC),  XD  and  XF  coded  Items,  and 
Items  without  EUUC  codes  but  with  features  where  they  could  be  expected  to  be 
coded  XD  or  XF. 

(e)  When  evaluating  repair  capability,  components  considered 
NUTS  are  those  with  action  taken  codes  2 through  0,  as  follows; 

2 Lack  of  equipment,  tools,  or  facilities 

2 Lack  of  technical  skills 

4 Lack  of  parts 

5 Shop  Iwcklog 

fi  = Lack  of  technical  data. 

(fj  Items  not  authorized  for  repair  (NUTS- 11,  excess  (NUTS-7), 
directed  to  be  shipped  (NUTS-8),  and  condemned  (NUTS-9>  are  considered 
neither  as  Items  repaired  nor  as  NUTS  Items  when  performing  repair  capability 
computation.  This  practice  Is  In  agreement  with  TO  00-20-3  computational 
procedures. 

(gl  Uepalred  components  are  those  returned  to  service  at  base 
level  (normally  by  the  Joint  test  force),  with  the  following  action  taken  codes: 

A - Bench  checked  and  repaired 

F - Uepalr 

Cl  - Uepalrs  and/or  replacement  of  minor  parts,  hard- 
ware, and  soft  goods 

K - Calibrated  - adjustment  required 
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li  - Adjust 

Z - Corrosion  repair. 

(h>  Bench  check  serviceable  rates  are  based  on  those  compo- 
nents where  off-equlpment  bench  check  actions  reveal  that  these  components  are 
serviceable  (action  taken  code  B and  how  malfunctioned  code  799). 

(1)  Could  not  duplicate  (CND)  rates  are  based  on  reported 
In-fllght  malfunctions  of  components  for  which  on-equlpment  actions  reveal  that 
no  repairs  are  required  (action  taken  codes  H and  J with  when  discovered 
codes  A,  B,  C,  D,  E,  G,  N,  P,  and  2). 

(j)  An  Item  removed  for  suspected  failure  counts  as  a demand  If 
the  work  center  that  normally  would  be  responsible  for  the  In-shop  test  or 
repair,  has  no  failure-confirming  test  capability. 

(k)  All  removed  components  coded  with  action  taken  codes  for 
repair  (A,  F,  G,  K,  L,  or  Z),  and  not  repairable  this  station  (NUTS  codes  1 
thi'ough  9)  are  counted  as  demands.  (Action  taken  code  B Is  not  included  as  a 
demand.) 


(l)  The  criteria  used  for  recording  maintenance  start  and  stop 
time  shall  also  be  applied  to  the  recording  of  support  equipment  start  and  stop 
time  for  the  assessment  of  AGP'  utilization  rates. 

(m)  Both  on-  and  off-equipment  maintenance  man-hours  shall  be 
accumulated  for  AGE  that  is  Ivlng  tested  as  support  equipment.  Man-hours 
shall  be  accumulated  In  accordance  with  the  groundrules  established  for  main- 
tainability parameters;  see  subsection  4-4b(l). 

(n)  The  quantitative  parameters  listed  in  table  4-2g  are 
generally  applicable  to  all  types  of  end  Items.  Two  additional  parameters  spe- 
cifically associated  with  jet  engine  supportablllty  are  also  provided  because  of 
their  Importance  during  aircraft  OT&E. 

Jet  Engine  Intermediate  Maintenance  (.TEIM)  Pipeline 
Time  is  the  accumulation  of  calendar  time  from  the  date  an  engine  is  removed 
until  the  date  it  is  reported  ready  to  install. 

2.  JEIM  Return  Rate  Is  the  percent  of  total  engines 
removed  for  cause  that  are  repaired  at  base  level  maintenance  and  returned  to 
service. 


(2)  Equations. 

(a)  Kepair  Capability. 


Repair  Capability  = 


Units  Repaired 


Units  Reprired 


/Units  with  Action  Taken \ 
I Codes  2,  9,  4,  9,  and  gI 


! 


I 
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where: 


i 


i 


I 

t 

I 

I 


Units  Kepalred  is  the  sum  of  all  items  repaired  over  the  time  span  of  the 
evaluation  period. 


Units  with  Action  Taken  Codes  2,  3,  4,  5,  and  fi  are  the  sum  of  all  items 
with  these  off-equipment  codes  over  the  time  span  of  the  evaluation 
period. 


(b)  Reparable  Repair  Itate  (Percent). 


Reparable  Repair  Rate 


Units  Repaired 


Units  Repaired 


/Units  with  Action  Taken\ 
Codes  1 through  9 * 


X 100 


where: 


Units  with  Action  Taken  Codes  1 through  9 are  the  sum  of  all  items  with 
these  off-equipment  codes  over  the  time  span  of  the  evaluation  period. 

(c>  Bench  Check  Serviceable  Rate  (Percent). 


Serviceable  Units . 

Rate  - Unltsl  ' (Serviceable  Units)  ‘ 


where: 


Serviceable  Units  are  the  sum  of  all  off-equipment  action  taken  code  B 
units  for  some  specific  time  period  (action  taken  codes  A,  F,  O,  K,  L,  V,  Z). 

Repaired  Units  are  the  sum  of  all  equipments  repaired  and  returned  to  an 
operating  condition  over  the  same  period  of  time. 

NOTK  : NRTS  actions  are  not  Included  in  the  denominator  of 
this  calculation  because  limited  test  capabilities  usually 
exist  during  OT&E,  and  NRTS  actions  increase  significantly 
under  these  conditions. 

(d)  Could  Not  Duplicate  (CND)  Rate  (Percent) . 

CND  Rate  (For  Operator  Reported  Malfunctions) 

On-Equipment  Could  Not  Duplicate  Actions  ^ 
C)perator  Reported  On-Fqulpment  Malfunctions 


where: 

On-Equipment  Could  Not  Duplicate  Actions  are  the  sum  of  the  unit  count 
for  action  taken  codes  H ana  J in  combination  with  when  discovered 
codes  A,  B,  C,  1),  E,  G,  N,  P,  and  2 over  some  specific  time  span. 
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(■H^orator  Reported  c^»-Kautpmont  Mnlftinotlons  are  the  sum  of  the  unit 
count  for  action  taken  cones  F,  G,  U,  .T,  K,  L,  1’,  It,  V,  X,  and  Z in 
combination  with  when  discovered  codes  A,  R,  C,  D,  K,  C.,  N,  P,  and 
2 over  the  same  specific  time  span. 

(e>  Mean  Time  Between  Demand  (MTRlh. 

Ml'RD  is  applicable  to  aircraft  and  all  other  end  items.  The 
method  of  calculation  is  dependent  upon  how  operating  time  is  accumulated  for 
the  item  under  test.  For  aircraft,  the  time  is  expressed  in  flying  hours;  for 
other  end  items,  it  is  ex^iressed  in  operating  hours. 

1.  MTBD  Aircraft. 


MTRD 


(Al 


Total  Remand  Actions 
Flight  Hours 


where: 


Total  Demand  Actions  are  the  sum  of  the  unit  count  for  on-equipment 
action  taken  codes  F and  11  in  combination  with  all  t.Nqie  1 and  2 how  mal- 
functioned codes,  less  action  taken  code  B combined  with  how  malfvinc- 
tloned  code  799  over  some  specific  time  span.  Note;  Time  change, 
scheduled  maintenance,  and  modification  removals  are  not  Included. 

Flight  Hours  is  the  accumulation  of  total  flying  hours  over  the  same 
specific  time  span. 

2.  hrrBn  other. 


i Total  Demand  Actions 
^(O)  Operating  Time 


where: 


Operating  Time  is  the  accumulation  of  actual  hours  that  an  item  is  in 
operation  based  upon  ETI  readings  or  historical  documents  (possessed 
time  less  down  timet  for  some  specific  time  period. 

(f)  AOE  Utilisation  Hates. 

Total  Operating  Time  per  Month 

^ (Number  of  Like  Pieces  of  AGE  Possessed! 


where: 

Total  Operating  Time  Per  Month  is  the  sum  of  the  operating  times  accu- 
mulated for  each  like  piece  of  AGE  based  on  ETI  readings  or  historical 
documents  (equipment  logs!. 
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Hour. 


{fC\  Support  Kqutpment  Maintenance  Man-Hours  Per  Oporatlng 


Hate 


On-Equipment  Man-Hours 
Operating  Time 


where; 


On-Equipment  Man-Hours  is  the  sum  of  on  equipment  lalxir  expended  for 
all  support  general  work  unit  codes  and  all  on-equipment  lalxir  expended 
on  work  unit  codes  requiring  preventive  and  corrective  maintenance 
actions  for  some  specific  time  period. 

Operating  Time  is  defined  in  para.  4— ld(2i(ei£. 

(h)  PME  No  Oefect  Rate  (Percent). 


Hate 


No  Defects 

Total  PME  Calibrated 


X 100 


where: 

No  Defects  is  the  number  of  PME  found  to  be  defect-free  during  scheduled 
calibration  accumulated  for  some  specific  time  period. 

Total  PME  Calibrated  is  the  total  number  of  i’ME  processed  for  calibra- 
tion over  the  same  time  period. 

(i)  Hequisition  Fill  Rate  (Percent). 


Itate 


;Ux}uisitions  Filled  . qq 
Total  Requisitions 


where; 

Requisitions  Filled  is  the  sum  of  requisitions  for  components,  modules, 
repair  parts,  consumables,  etc. , that  are  filled  by  base  supply/ 
contractor  within  prescribed  time  limits  over  some  specific  time  span. 
Items  withdrawn  from  an  established  bench  stock  are  not  Included. 

Total  Requisitions  is  the  sum  of  all  requisitions  presented  to  base 
supply/contractor  over  the  same  specific  time  period. 

(j)  Cannibali'/.ations  Per  Startles  Flown. 

Cannibalization  Actions 
Sorties  Flown 


where; 


Cannitolization  Actions  is  the  sum  of  all  on-equipment  action  taken 
codes  T accumulated  over  some  specific  time  period. 

Startles  is  the  total  numlvr  of  sorties  flown  over  the  same  time  period. 

(k)  Jet  Engine  Supportability  Parameters. 

1^.  JKIM  pipeline  time  provides  an  assessment  of  enRine 
turnaround  time  at  the  base  level  maintenance  facility.  The  various  u-pes  of 
actions  that  can  be  expected  include  but  are  not  limited  to: 

a.  Uemoved 

li.  Awaitins  Maintenance 

c.  In  Work 

d.  KnRine  Not  Operationally  Ready-Supply  (KNORS) 

e.  Serviceable  - Raw 

L Serviceable  - Built-up 

This  information  is  used  to  determine  spares  requirements,  and  evaluate  the 
enplne  maintenance  concept  and  supportabillt>-  with  respect  to  sustaining  an 
operationally  ready  rate.  In  combination  with  scheduled  and  unscheduled 
removal  rates,  in-work  calendar  days  can  be  useful  for  evaluating  JKIM  crew, 
support  equipment,  and  facility  requirements. 

2.  JKIM  Return  Rate  (Percent!. 

_ Number  Returned  to  Service  at  Base  Level ^ 

Rate  - Removals)  - (Scheduled  Removals  • Directed  Removalsl  ‘ 


where: 


Number  Returned  to  Service  is  the  sum  of  all  engines  returned  to  service 
from  base  level  maintenance  over  some  specific  time  period. 

Total  Removals  is  the  sum  of  all  engines  removed  over  the  same  time 
period. 

Scheduled  Removals  is  the  sum  of  all  engine  removals  on  a scheduled 
basis  over  the  same  time  period. 

Directed  Removals  is  the  sum  of  all  directed  engine  removals  over  the 
same  time  period. 


(a)  The  standard  deviation  Is  another  Index  of  variation  and  Is 
expressed  In  the  same  units  as  the  original  data.  The  standard  deviation  Is  the 
square  root  of  the  variance.  The  equation  for  estimating  the  standard  deviation 


i 


(fh 


(4)  Central  Tdmlt  Theorem. 

Numerous  distributions  of  populations  have  been  Identified  and 
their  properties  mathematically  described.  Of  particular  significance  is  the 
normal  distribution,  sometimes  called  the  Gaussian  distribution,  which  is 
depicted  by  a symmetrical  bell  shaped  curve.  This  distribution  is  Important 
because  the  sample  means  from  many  types  of  distributions  tend  toward  being 
distributed  normally  under  certain  very  broad  conditions.  This  Is  referred  to 
as  the  "Central  Limit  Theorem".  Thus,  If  a population  has  mean,  p*,  and 
variance  (j2  then,  using  the  Central  Limit  Theorem,  the  sample  mean  is 
normally  distributed  with  mean  p and  variance 

(5)  Confidence  Intervals. 

It  was  previously  indicated  how  certain  population  parameters  are 
estimated.  These  arc  known  as  point  estimates.  On  occassion,  an  Interval 
estimate  may  be  of  more  interest  than  a point  estimate.  Typically,  an  interval 
estimate  is  composed  of  a specified  Interval  and  the  probability  that  that  Interval 
includes  the  true  parameter  value.  This  probability  Is  often  referred  to  as 
confidence  and  hence  the  name,  "confidence  Interval". 

(a)  For  example,  assume  that  It  Is  desired  to  determine  an 
Interval  which  has  a pre-determlned  chance  of  bounding  the  true  mean  of  a popu- 
lation whose  mean,  p.  Is  unknown  and  whose  variance,  , Is  known.  Tly 
appeal  to  the  Central  Idmlt  Theorem,  we  can  say  the  sample  mean  Is  from  a 
normal  population  with  mean  p and  variance  cr^/n.  Further,  using  a normal 
distribution  table  (see  reference  (7)(b>,  page  4-100)  a confidence  Interval  can  be 
formed,  l.e.. 


100  (l-aVT  confidence  Interval  for  p 


(c) 


*In  statistics  true  values  are  usually  deslgnati  d by  using  Greek  letters  and 
estimates  are  designated  by  the  use  of  Homan  letters. 
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where 


a Is  a probability 


^'(1  - «/2) 


Is  a number  taken  from  established  tables  of  the  normal 


distribution. 


(b)  Explicitly,  assume  that  equations  (a),  (b),  (c),  and  (d)  have 
provided  the  following;  results;  From  15  observations,  the  mean  man-hours  per 
flyinp  hour  (MH/FH)  are  37.8,  and  the  original  population  variance  Is  known  to 
be  15.71.  \^at  Is  the  90'?  confidence  Interval  for  the  mean  MH/FH? 


Then  for  equation  (e), 

O'  0. 10  (1  - 0. 90) 

X = 37.8 


'(1-0/2)  ■ ^'0.95 


1.045 


Thus,  the  90'?  confidence  Interval  for  p is  37.8  + 1.045 
which  reduces  to  the  Interval  (30.12,  39.48). 


(0)  Student’s  t-Dlstrlbutlon. 


In  most  cases,  however,  the  true  variance  Is  not  known  and  hence 
a different  distribution,  called  the  t-dlstrlbution  or  Student's  t-dlstrlbutlon.  Is 
used.  The  t-dlstrlbutlon  Is  really  a set  of  distributions  since  the  sample  size,  n, 
appears  In  Its  mathematical  description;  thus  a different  distribution  for  each 
sample  size.  In  this  case  the 


s 

100  (1  -a)%  confidence  Interval  forp  X + 

\i  - f ; n-1) 

X 

v/n 

where: 

t.,  /_  Is  the  Student's  t value  from  the  distribution  with  (n-1) 

(1  -o/2  ; n-1) 

degrees  of  freedom. 

Thus,  In  the  previous  example  let  the  calculated  variance  be  15.71. 
Then  by  noting  the  t-value  as  1.701  from  reference  (7)(b)  (page  4-100), 


100  (!-«)*?  confidence  Interval  for  p 


37.8  + 1.701 


vyi5.71  _ 
v/lS" 


(30.00,  39.00) 
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(7)  lleferencos.  j 


There  are  additional  statistical  techniques  available  for 
developing  confidence  Intervals  for  various  distributions.  Information  concern- 
ing these  techniques  can  be  found  in  the  following  textbooks: 

(a)  A.  llald.  Statistical  Theory  with  Engineering 
Applications  - John  Wiley  and  Sons,  Inc. , New  York, 

N.  Y.  - 19fi0 

(b)  A.  llald.  Statistical  Tables  and  Formulas  - John  Wiley 
and  Sons,  Inc.,  New  York,  N.Y.  - 19fi0 

(c)  N.  Mann,  11.  Schafer,  N.  Slngpurwalla,  Methods  for 
Statistical  Analysis  of  Reliability  and  Life  Data  - John 
Wiley  and  Sons,  New  York,  N.Y.  - 1971 

(d)  R.  Splcgal,  Theory  and  Problems  of  Statistics  - Schaum 
Publishing  Co. , New  York,  N.Y.  - l9fil 

(e)  A.  W.  Wortham  and  T.E.  Smith,  Practical  Statistics  In 
Experimental  Design  - Dallas  Publishing  House, 

I Dallas,  7'exas  - 1959 

(f)  11.  Langley,  Practical  Statistics  Simply  Explained  - 
Dover  Publications,  Inc.,  New  York,  N.Y.  - 1971 

(g)  D.  B.  Owen,  Handbook  of  Statistical  Tables  - Addison- 
Wesley  Publishing  Company,  Inc. , Reading,  Mass  - 
19fi2 

j (h)  J.W.  Pratt,  H.  Ralffa  and  R.  Schlalfer,  Introduction  to 

Statistical  Design  Theory  - McGraw  Hill  Book  Company, 

New  York,  N.Y.  - 1965. 

f.  Quality  of  Data. 

I 

This  subsection  discusses  the  need  for  data  quality,  describes  contri- 
butors and  sources  of  error,  and  Identifies  ways  of  Influencing  the  quality  of 
data  collected.  The  accuracy  of  logistics  assessments,  and  the  decisions  based 
thereon,  depend  on  both  the  quantity  and  quality  of  data  collected.  The  quantity 
of  data  compiled  in  support  of  a specific  test  objective  or  suliobjectlve  affects 
the  statistical  confidence  value  assignable  to  the  data.  Similarly,  the  quality  of 
the  data  collected  also  Influences  the  degree  of  confidence  associated  with  the 
results  of  the  data  collection  process.  The  data  gathered  and  processed  during 
OT&E  must  be  credible. 


(1)  The  Maintenance  Data  Collection  System  has  not  enjoyed  a 
reputation  for  data  accuracy.  Itesults  of  an  Inspection  of  the  USAl-'  Maintenance 
Data  System,  22  September-29  December  19fi9  by  The  Inspector  General 
("Report  of  Audit  4314-4,  436  Bombardment  Wine,  Maintenance  Data  Collection 
System  — Production  Records  and  Reports"  Beale  AFB  CA,  17  August  1973); 
and  a HQ  SAC,  Aircraft  Engineering  Division  Report  (No.  P-238,  "Maintenance 
Data  Collection  Errors",  27  November  1974),  highlighted  the  problems  and 
Illuminated  causes  thereof. 

(a)  For  those  concerned  with  the  quality  of  OTK.F  data,  the 
Novembt'r  1974  SAC  study  Is  most  useful.  The  results  of  that  study  revealed: 

1.  Twenty-six  percent  of  AFTO  form  349  entries  were 

Incorrect. 


2.  Gf  the  errors  found,  18  percent  were  due  to  lack  of 
corresponding  action  taken  codes  P (removed)  and  Q (Installed),  l.e. , a 
component  was  reported  as  removed  but  there  was  no  corresponding  subsequent 
Installation  action  reported  (or  vice  versa). 

3.  Of  the  errors  found,  9 percent  were  attributed  to  a 
similar  lack  of  correspondence  between  action  taken  codes  T and  U for 
cannlballzatlons. 


4.  Twenty-four  percent  of  the  errors  were  due  to  unmatched 
on  and  off-equlpment  actions.  Reported  off-equlpment  activity  could  not  be 
traced  to  a requisite,  preceding  on-equlpment  event,  and  vice  versa. 

5.  Some  of  the  errors  were  detected  by  the  base-level 
computer  error  edit.  Slxty-slx  percent  of  the  computer  detected  errors  were 
created  during  keypunching.  During  the  study  of  November  1974,  the  computer 
edit  routines  detected  only  8 percent  of  the  actual  documentation  errors.  The 
edit  routines  have  since  been  revised  and  It  Is  likely  that  routines  existing  today 
would  Identify  a larger  portion  of  errors.  It  should  be  emphasized,  however, 
that  once  data  Is  accepted  by  the  B3500,  It  cannot  be  changed.  Some  organiza- 
tions are  supported  by  command-unique  data  systems  which  use  data  stripped 
from  the  MDCS  tapes.  If  corrections  or  adjustments  ai'e  made  to  the  command- 
unique  MDCS  data,  the  results  produced  will  be  disparate  with  the  MDCS  data 
bank  and  the  AFLC  1X156  data  derived  thereform.  This  disparity  weakens  the 
credibility  of  OT&E  logistics  assessments.  Attention,  therefore,  should  be 
focused  on  that  phase  of  data  collection  and  processing  which  precedes  the  data 
automation  activity. 


6.  In  the  SAC  study,  the  AFTO  form  349  entries  having 
significant  error  rates  were  found  to  be: 

a.  Work  unit  code  - 29.  7 percent  of  the  total  errors 

b.  How  malfunction  code  - 28.2  percent  of  the  total 


errors 
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c.  Action  taken  code  - 20.fi  percent  of  the  total  errors 

d.  Other  entries  contributed  to  the  error  rate  to  a 
lesser  degree  (when  discovered  code,  8.0  percent;  units  complete,  fi.  1 percent; 
type  maintenance  code,  3.8  percent). 

7.  The  Investigation  revealed  certain  conditions  believed  to 
have  contributed  to  errors.  These  were: 

a.  Forms  were  not  filled  out  as  work  was  performed, 
but  at  the  end  of  the  work  shift. 

b.  Emphasis  was  on  selecting  codes  or  combinations  of 
codes  known  to  be  acceptable  by  the  B3S00  edit  routines. 

£.  There  was  a lack  of  understanding  of  how  to  docu- 
ment certain  actions. 

d.  Included  In  -Ofi  code  manuals  arc  different  work  unit 
codes  for  the  same  t5T}e  component.  The  -Ofi  code  manual  In  one  case  applied  to 
an  aircraft  configured  with  either  of  two  different  engines  (J57  and  TF33).  Also, 
different  WUCs  are  used  for  similar  components  associated  with  the  two  different 
engines. 


8.  Work  centers  generating  large  volumes  of  AFTO  forms 
349  generally  had  the  highest  error  rate.  During  one  OT&K  program,  the  test 
force  reported  approximately  40  percent  of  the  data  were  either  erroneous  or 
missing. 


(2)  Actions  that  can  be  taken  to  Improve  the  quality  of  OT&F  data 

Include: 


(a)  Indoctrination  of  data  collectors,  with  emphasis  placed  on  the 
need  for  credibility  dictated  by  the  use  of  the  data  at  Program  Acquisition 
Reviews,  Secretarial  Program  Reviews,  Defense  System  Acquisition  Review 
Council  presentations,  and  briefings  to  the  Air  Staff  and  Major  Command  com- 
manders and  their  staff.  Processed  data  are  also  subject  to  use  by  Congress 
and  the  General  Accounting  Office  (GAO).  Independence,  objectivity,  and 
credibility  are  very  tenuous  attributes  that  are  difficult  to  acquire  and  easily 
lost. 


(b)  Training  of  personnel  Involved  In  completing  forms. 
Emphasis  should  be  placed  on  areas  Identlfed  as  weak  by  the  SAC  study. 

(c)  Provision  of  selected  personnel  with  copies  of  the  D3fi00 
error  edit  routine  to  facilitate  correction  of  data  rejected  by  the  D3500.  A copy 
of  a recent  113500  error  edit  Is  Included  In  appendix  4-4A. 
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(d)  Establishment  of  a data  review  function.  Versions  of  this 
activity  have  Involved: 


cards. 


1.  Use  of  an  80-80  listing  produced  from  the  key  punchtul 


2.  Weekly  publication  and  distribution  of  error  rates  by 
work  center  and  type  error. 

3.  Use  of  the  base  level  Inquiry  (or  oqulvalentl  system  to 
evaluate  matches  lietween  action  taken  codes  E and  Q,  and  between  r and  U,  and 
between  on-equlpment  and  requisite  off-equlpment  actions. 

4.  Comparison  of  the  quantity  of  fllRht  loRRed  dis- 
crepancies with  the  quantity  of  correspondlnR  on-equlpment  repair  actions, 
fl'hls  Is  useful  for  monltorlnR  the  adequacy  and  timeliness  of  contractor 
reported  data.) 

(3)  The  preceding;  Information  should  be  reviewed  and  appropriate 
action  taken  early  In  the  test  program  and.  In  some  cases,  before  OT&F  lieglns. 
Early  emphasis  on  quality  of  data  will  minimize  the  difficulty  of  Identifying  and 
resolving  problems  later  In  the  test  program. 


4-5.  DATA  SYSTFMS. 

This  sectloa  Is  divided  Into  two  subsections:  Data  System  Summary 
(section  4-5a)  and  Data  System  Description  (section  4-5b).  Subsection  4-5a  pre- 
sents tables  serving  as  a ready  reference  to  definitions  and  sources  of  data  for 
the  various  elements  of  the  logistics  measure-of-effectlveness  parameters;  and 
discusses,  as  cautionary  information  for  potential  users  of  the  Malntenanace 
Data  Collection  and  Pi-oduct  Performance  Systems,  certain  limitations  and 
anomalies  of  these  systems.  Subsection  4-5b  describes  the  output  products  of 
data  systems  applicable  to  logistics  assessment. 

a.  Data  System  Summary. 

(1)  This  subsection  provides  tabulated  Information  relating  the 
parameters  of  the  logistics  measure-of-effectlveness  equations  discussed  in 
subsection  4-4  to  the  data  system  output  reports  where  quantitative  Information 
on  the  parameters  can  be  obtained. 

(2)  Table  4-5a  lists  the  parameters  used  In  obtaining  the  prime 
measures  of  effectiveness  (1.  e, , reliability,  maintainability,  availability,  sup- 
portabllltyl , references  the  paragraph  of  section  4-4  where  the  equations  are 
discussed,  and  refci*ences  specific  Items  of  table  4-5b,  the  data  system  source 
listing. 


(31  Table  4-5b  lists  31  variables  (parameters  and/or  data  elements), 
the  data  systems  and  specific  report  number  where  data  on  these  variables  can 
be  obtained,  the  source  document  of  the  data,  and  a reference  to  appendixes  of 
this  document  wherein  detailed  descriptions  of  the  data  system  output  reports 
and  report  samples  can  be  found. 

(4)  Table  4-r>c  consists  of  matrices  of  data  system  products  versus 
data  elements,  parameters,  and  variables.  These  matrices  provide  summaries 
of  the  specific  Information  available  from  the  outpvit  reports  discussed  in  sub- 
section 4-5b,  and  the  respective  appendixes.  They  can  be  used  In  narrowing  the 
search  for  specific  output  reports  relative  to  selected  variables. 

(5)  Two  of  the  primary  data  systems  applicable  to  logistics  assess- 
ment are  the  Maintenance  Data  Collection  System  and  the  Product  Performance 
System.  Limitations  of  these  systems  are  discussed  In  paragraph  4-5a(fi) 

and  (7). 

(6)  Characteristics  of  Maintenance  Data  Collection  (MDC)  System  and 
Product  Performance  System  (D056).  and  limitations  on  their  applications. 


(Text  continued  on  page  4-175.) 
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Reference 

Data  (Handbook 

Data  Element/Parameter  System  Report  RCS/PCN  Source  Document  Appendix) 
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Reference 
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catastrophic) 


day  of  month  (histogram) 


ill 


TABLE  4-5c(l).  OUTPUT  REPORT  DATA  MATRIX,  AEROSPACE 
VEHICLE  AND  EQUIPMENT  INVENTORY,  STATUS,  AND 
UTILIZATION  REPORTING  SYSTEM  (APR  65-110) 


Source  Documents:  AF  Form  359  (for  Aerospace  Vehicles  and  Training 
AF  Form  2445  (for  CEM) 


No.  No.  I Report  Title 


A.  AEROSPACE  VEHICLE  REPORTS,  RCS:HAF-LGY(D)7140 

f N260007  Aerospace  Vehicle  Status  Report 

2 N260008  Aerospace  Vehicle  Status  Distribution  Report 

3 N260009  Aerospace  Vehicle  WUC  Report 

4 N2(i0010  Aerospace  Vehicle  Flying  Report 

5 N260011  Aerospace  Vehicle  MCS  Summary  Report 

6 GGB7F0A  Aerospace  Vehicle  Status 

7 GGB7F0B  Aerospace  Vehicle  Status 

8 GGBDFOB  Top  25  Unscheduled  Item  NORM/NORS 

9 GGJ3F0B  Summary  of  Unscheduled  Items  NOR 

10  GGJ7F0A  Aircraft  Inventory 

11  GGJBFOA  Aerospace  Vehicle  Flying  Report 

12  GGJBFOB  Aerospace  Vehicle  Flying  Report 

B.  CEM  REPORTS,  RCS:HAF-LGY(M)7152 

1 N265007  Daily  Detail  Status  (Open  Incidents  Only) 

2 N265008  CEM  Master  Inventory  by  Organization 

3 23110A  Daily  Detail  Status  (Open  Incidents  Only) 

4 23115A  Command  CEM  Equipment  Status  Summary 

5 23125A  Monthly  WUC  Summary  - Unscheduled  Maintenance  Downtime 

6 23130A  Monthly  CEM  Detailed  ESR  Listing  by  TMS 

7 23135A  Monthly  CEM  Detailed  ESR  Listing  by  Organization 

8 23140A  Monthly  CEM  Master  Inventory  by  TMS 

9 23145A  Monthly  CEM  Master  Inventory  by  Organization 

10  23146A  TMS  Totals  by  Subcommand 

11  23150A  Monthly  WUC  Summary  - Supply  Delays 

12  23165A  End  Item  Summary  by  TMS 

C.  TRAINER  REPORTS,  RCS:HAF-DPM(M)7101,  2,  3 


1 IN272003 

2 In22403A 


Monthly  Base  Level  Trainer  Status  Summary  Report 
Monthly  Base  Level  Trainer  Status  Summary  Report 


Maintenance/Failure 
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TABLE  4-5c(2).  OUTPUT  REPORT  DATA  MATRIX 
ENGINE  MANAGEMENT  PRODUCTS  (D024) 


Time/Frequency  Informatioa 


Source  Docuincni:  AF  F'orm  1534 


/W  / MWi 

/i/i/i/i/A 

I / 1 /^iyoA/'Sr/o/o/  /WW'W'V/h// 


Report  Title 


D()24AEniA  Propulsion  Unit  Oper.  Time  and  Reconciliation  Report 
(Part  1) 

1)()24AE1!IA  Propulsion  Unit  Oper.  Tinre  and  Reconciliation  Report 
(Part  2) 

rK)24BBElVV  ENORS  Uninstalled  Engine  Status  Report  Summary  by 
Cmri. 

l)024BBE2VV  ENORS  Command  History 
D024BBJl\V  ENORS  Uninstalled  Engine  Status  Report 
D024BBNl\V  ENORS  Uninstalled  Engine  Status  Report  Type 
D024BBRl\V  ENORS  Uninstalled  Engine  Status  Report  by  Serial  No, 
D024BCDIM  Propulsion  Unit  Reparable  Report 
D024BGUIM  Propulsion  Unit  Foreign  Object  Damage  Report 

D024BJG2M  Propulsion  Unit  Report  System  Overhaul  and  Base 
Maint.  Comp. 

D024CDG3W  Spare  Engine  Report 

D024CHS1M  <3CALC  Prop.  Unit  Resupply  Time  Report,  Part  I 
D024DAE1Q  Prop,  Unit  Pipeline  Analysis,  Part  2 
DO24Ft021  Installed  Aircraft  Engine  Report 
DO24FI022  Official  Failure  Rate  Tech.  Data  Record 
DO24FI023  Aircraft  Engine  Exposure  Product 

DO24FI031  Aircraft  Engine  Removal/Loss  Report 

DO24FN021  Aircraft  Engine  Exposure  Product 

DO24FN022  Aircraft  Engine  Combined  Fail  Rale  Prod. 

DO24FN023  Aircraft  Engine  Experience  Analysis  Report 
DO24FR0H  Aircraft  Engine  Overhaul  Failure  Rate  Product 
DO24FR021  Aircraft  Engine  Field  Maint.  Failure  Rate  Product 
DO24FR031  Aircraft  Engine  Combined  Failure  Rale  Product 
DO24FR041  Aircraft  Engine  Overhaul  Failure  Rate  Product 
DO24FR051  Aircraft  Engine  Field  Maint.  Failure  Rate  Product 
IK)24FY0ll  Aircraft  Engine  Experience  Anaivsis  Product 
I)()24Kp03l  Forecasted  Aircraft  Engine  Removals  bv’  Quarter 
DO24KP041  Forecasted  Aircraft  Engine  Removals  by  Command 

D024Kp(>(ii  Official  USAF  Actuarial  Removal  Interval  and  Eng. 
Life  Expectancy  Tables 
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TABLE  4-5c(4).  OUTPUT  REPORT  DATA  MATRIX 
INCREASE  RELIABILITY  OF  OPERATIONAL  SYSTEMS 


Cost  Information 


System  Effectiveness  Info, 


(IROS;  K051) 


Source  Documents; 


l>i),')t)  Product  Pcrlorm:uiCf 
Svstcm;  (1033  Aerospace 
Vehicle  Inwnlorv,  Kquipmc  u 
and  Status  Hept)rt 


HO  it  No. 


Heport  Title 


1 K()31.YR1L 


System  Effectiveness  Report, 
Force  Summary 


KOfjl.  YRIL 


Svstcm  Effectiveness  Report. 
T rend  Data 


3 K051.PW5L 


LSC  Rankinf;.  Selected  Equip. 
VVL’Cs 


4 K051.PNIL  LSC  Ranking.  Selected  Items 


5 K051.PN3L  LSC  Ranking.  Wl'C  Status 


K051.PN4L 


LSC  Breakdown  - Current 
Quarter 


K051.PN6L  LSC  Ranking,  NSN  Status 


K051.PN7L  I Maintenance  Action  Summary 


10  K051.PW2L 


LSC  Ranking  Item  Mgr  NSN 
Status 


11  K051.PW3L 


LSC  Ranking,  High  Burner 
WUC 


12  K051.PW4L 


LSC  Ranking,  Weapon  System 
Correlation 


13  K051.PZ1L 


LSC  Ranking.  Ground  CEM 
Equipment 


14  K051.YN1L  I System  Avail.  Selected  WUCs 


K051.YN3M  I System  Avail.  WUC  Status 


16  K051.YN4M 


System  Avail.  WUC  Comp. 
Data 


17  I K051.YN5M  I System  Avail.  Aircraft  Status 


IK  K051.YN6M 


System  Avail.  Aircraft  Comp. 
Data 
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TABLE  4-5c(5).  OUTPUT  REPORT  DATA  MATRIX 


Maintenance/Failure  Information 


PRODUCT  PERFORMANCE  SYSTEM  (D056) 


Soiim*  Documvnls:  f{CS:L(Xj-.\lMOt AH»7I42 
AFTO  Form  349 
AFI'O  Form  34<) 


M/l/i/ 

I 


mmi/L 


MIM/ 


No.  I i<ejx>rt  No. 


I)(>:>(5B.>00{) 


l)()r)GB50l0 

I)O5(>n301l 


4 iJ()r)<;Hr)0i5 


i)or>()Br)Oif> 


DOr)6B5022 


DO56B5023 


10  DO56B5503 


11  005685504 

12  005635505 

13  D056B5527 


14  I D056B6528 


15  005686529 


16  DO56C4402 


DO56C4403 


18  OO56C4404 


19  D056C4417 


20  D056C5009 


21  D056C5010 

22  DO56C5027 


23  OO56C5605 


24  DO5(>C5903 

25  D056C5929 


Heport  Title* 


/ /Wm 

' t/t/t/o/W^/^/</ * h I h h I h ' f h ^ S h //  /c?/ 


mti 


^ v hs  r 
AA/r?'/; 

f T/  T/  O/fi^ 


Maim.  Actions,  Man-Hours,  and 

Ai>orts  bv  Wl'C 

Inspection  Interval 

Inspection  Occurrence  Interval 

Material  Saletv  Oeliciencv 

Report 

Work  Unit  Code  Corrosion 
Summary 

System  ^Subsystem  Corrosion 
Summary 

Svstem/Subsystem  Wl'C 
Failure  Summary 
Failure  Rate  Data  for  Selected 
WCCs 

Maim.  MH/FH  by  Weapon. 

System.  CMD 

Detail  Maint.  Action  for 

Selected  WUCs 

Detail  Shop  Actions  for  Sel.  WUCs 
Sum'd  Maint.  Actions  for  Sel.  WVCs 
Maintainability  - Reliability 
Summary 

Cannibalization  Actions  - CMD 
Summary 

Cannibalization  Actions  - bv 
Weapon  System 

Selected  Part  No.  Action  Summary 
Maint.  Actions  for  Selected  FIINs 
Part  Replaced  During  Field  or 
Depot  Repair 

Maint.  Reparable  Processing 
Summary 

USAF  Command  NRTS  and 

Repaired  Summary 

Base  NRTS  and  Repaired  Summary 

Equipment  NRTS  and  Repaired 

Summary 

Bit  and  Piece  Replacement 
Summary 

PME  Calibration  Interval  Analysis 
Summary  of  PME  Maintenance 
Actions 


X X XX 


TABLE  4-5c(6).  OUTPUT  REPORT  DATA  MATRIX 
MAINTENANCE  COST  SYSTEM  (MCS) 


Cost  (Dollars) 
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TABLE  4-5c(7).  OUTPUT  REPORT  DATA  MATRIX 
MAINTENANCE  DATA  COLLECTION  (MDC) 
SYSTEM  (AFM  66'!.  66-267) 


Source  Documents:  AFTO  Form  349 


Keix>rt  No. 

Ileport  Title 

sc'.ooiHir.i 

mix;  Master  ID  Fisting  bv  ID  Number 

SHOOUU.VJ 

mix;  Master  II)  Listing  bv  Owning 

Work  Center 

SGi>0Uil33 

MDC  Master  ID  Listing  Bv  End  Item 

sc;ooirn.j4 

MDC  Master  II)  Listing  bv  Performing 
Work  Center 

SGOOUSDi2 

MDC  Equip.  Sched.  Part  1 bv  Perform. 
Work  Center 

S(;noiiu(i3 

MIX'  Equip.  Schod.  P.irt  11  bv  owning 

Work  Center 

SCOOlBJlM  301 

MDC  Dailv/ Monthly  Trans.  Listing 
Section  A - On  Equipment 

si;()oiii:v>2/502 

MDC  Dailv  Monthly  Trans.  Listing 
Section  B - Off  Equipment 

SG001B3‘i3  503 

MDC  Dailv  'Monthly  Trans.  Listing 
Section  C - Support  General 

S(;00lB324'r)04 

MDC  Daily/Monthly  Trans,  Listing 
Section  D - Indirect  Labor 

SG001B325/505 

MDC  Daily/  .Monthly  Trans,  Listing 
Suction  E - Parts  Replaced 

SG001B326/50G 

MDC  Dailv 'Monthly  Trans.  Listing 
Section  F - Serially  Controlled  Time 
Change 

S0001B327/507 

MDC  Dailv/Monthiv  Trans,  Listing 
Section  G - Engine  Remove  and 

Replace 

SG001B511 

MDC  Work  Summary,  Part  L Direct 
Labor  bv  End  Item 

sc;ooiBr)2.> 

.MDC  Work  Summary,  Part  2,  Direct 
Labor  bv  Work  Center 

.SG00iBr)3r> 

MDC  Work  Summary  , Part  3,  Indirect 
Labor  bv  Work  Center 

SG001B536 

MDC  Activity  Identifier  Summarv, 

Part  3,  Indirect  Labor 

S(;ooiBr,4i 

MDC  Activity'  Identifier  Summarv, 

Part  1 by  PWC 

SG00IB.')42 

MDC  Activity  Identifier  Summarv, 

Part  2 bv  AI 

SC.001B771 

Aero-Veh  (On-Equip)  Job  Ave/Perf. 
Hi-Liles  (Month) 

SG001B772 

Off-Equlp.  Job  Ave/Perf.  Hi-Lites 
(Month) 

SG001B7K1 

High-2r)  On-Equip.  Failures  (Month) 

SG001B791 

f!igh-2rj  Man*Hour  Consuming  Jobs 
(Month) 

(a)  Failure  Data. 


The  definition  of  a failure,  i.  e. , how  failures  are  counted, 
differs  between  the  MDCS  and  D056  systems.  These  differences  and  certain 
unique  aspects  of  each  system  are  as  follows* 

1.  Only  code  A how  malfunctioned  codes  are  counted  as 
failures  in  the  MDCS;  induced  failures  (code  B)  are  excluded  (see  para- 
graph 4-4a(l)(d)  and  appendix  4-2A).  Thus  the  MDCS  failure  count  does  not 
represent  total  demand  on  the  maintenance  activity  or  supply  resources.  No 
off-equipment  actions  are  involved  in  the  identification  of  MDCS  failures. 

2.  The  D056  failure  count  is  related  to  repair/ 
replacement  action  taken  codes;  the  MDCS  is  not.  Only  action  taken  code  Q 
(installed)  or  Y (troubleshoot)  affect  MDCS  failure  count.  Any  data  class  A 
or  B how  malfunctioned  code  in  combination  with  action  taken  code  Q or  Y is 
a non-failure  data  class  C for  MDCS. 

3.  All  how  malfunctioned  codes  used  for  failure  counting 
in  the  MDCS  are  used  in  the  D056.  However,  the  D056  also  includes  failures 
for  how  malfunctioned  codes  (correlated  with  appropriate  action  taken  codes) 
142,  143,  and  750. 


4.  Induced  failures  in  the  D056  (type  2)  are  consistent  with 
those  in  the  MDCS  (code  B)  except  that  how  malfunctioned  code  948  (no  defect  — 
operator  error)  is  counted  as  an  induced  failure  in  D056  but  as  a non-failure 
(code  C)  In  the  MDCS;  and  how  malfunctioned  code  750  is  included  as  an  induced 
failure,  class  B,  in  MDCS,  but  as  an  inherent  failure,  type  1,  with  D056.  All 
other  "no  defect"  failures,  i.e. , D056  t3T>e  6 and  MDCS  how  malfunctioned 
codes  C and  D,  are  consistent. 

5.  Unlike  the  D056,  the  MDCS  failure  count  includes  com- 
ponents removed  as  reported  failures  that  subsequently  check  serviceable  in 
the  shop.  This  method  represents  a true  measure  of  demand  for  on-equipment 
maintenance  resources.  However,  the  D056  method  provides  a more  accurate 
indicator  of  supply  replacement  requirements  based  on  a remove,  repair,  and 
return  maintenance  policy. 

6.  Neither  the  MDCS  nor  D056  accounts  for  failures  of 
items  bench-checked  upon  removal  from  supply,  i.e. , when  discovered  code  Y. 
Both  D056  and  MDCS  failure  count  are  based  on  on-equipment  reported  defects 
only. 

7.  Unit  count  (units  completed)  is  provided  for  in  both  the 
D056  and  MDCS.  However,  the  D056  does  not  include  as  a failure  action  taken 
code  G when  used  with  a type  1 how  malfunctioned  code  at  the  fifth-digit  WUC 
level.  Because  of  this,  the  failure  count  from  the  MDCS  for  a WUC  component 
(five  digits)  probably  would  be  higher  than  the  D056  failure  count.  The  MDCS 
products  do  not  summarize  failure  experience  at  the  system  (two-digit)  or  sub- 
system (three-digit)  levels  as  does  the  D056,  although  this  could  be  done  manu- 
ally or  by  using  the  Base  Level  Inquiry  System  (BLIS). 
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S.  riu'  MIH'S  does  not  proviilo  IM'l’HF  \ aliii‘!S,  \x  hoivas  tho 
nDfiti  iloos.  Usually,  MDC'S  failuros  must  Ix'  arithmotioallv  oomhiiunl  with 
flyittH  oiH'rating  timo  to  obtain  M TBF  cominUations.  Siinu'  commaml-uniquo 
data  automation  systems  feature  an  automated  caiKibility  for  jK'rforming  this 
funetion, 

(bl  Man-llour  Uata. 

U The  primary  source  for  eomputinn  man-hours  per  flyinij 
luHjr  or  sortie  is  the  MIH'S  Work  Sumnuiry,  I’art  1,  Uireet  LaUu-  by  Fnd  Item 
(Pt'N  SUiOOlBSll),  AFM  paragraph  5 -IS a.  I'lu'  sorting  sequence  is; 

a.  Fquipment  classification  by  chief  of  maintenance 

b.  lO  number,  or  end  item  iilentity  if  no  in  number 

is  assigned 

c.  lype  maintenance 

d.  Performing  work  center. 

2.  By  sorting  based  on-equlpTnent  classification  codes,  the 
following  anomalies  arise  with  respect  to  man-hour  computations  for  a specific 
weap<.m  system: 

a.  In-shop  engine  work  will  appear  separately,  and 
must  be  added  to  the  man-hour  oxix'nditures  shown  for  the  aitvruft.  In-shop 
engine  man-hours  can  be  separately  determined  by  a sort  on  the  last  two  digits 
of  the  equipment  class  ctxie  because  they  are  the  same  as  those  used  by  the 
assi>ciated  aircraft. 

b.  The  same  equipment  classification  code  (XHtb  is 
used  for  all  H&D  maintenance;  therefore,  during  UTiiF,  engine  in-shop  man- 
hour exfx'nditures  cannot  be  correlated  to  a sjx'cific  test  aircraft  using  MIX'S 
products,  e.g. , .A-IO  engine  maintenance  would  not  be  distinguished  from  that 
hir  the  F-lt>  engine.  However,  effective  1 tHtober  7d,  a separate  standard 
reporting  tlesignator  (SHD)  will  be  used  for  each  engine.  These  new  codes  will 
replace  the  equipment  classification  codes. 

c.  Aircraft  man-hour  expenditures  do  not  include 

expenditures  for: 

11  .Aerospace  ground  equipment  (VX^t'l,  code  Gl. 
S<une  man-hours  can  be  separately  identified  for  peculiar  AGK  managed  umler 
the  Advanced  Configuration  Management  System  f.ACMS),  ami  added  to  the  end 
item  man-hours.  This  will  not  include  automatic  test  equipment  cmled  in 
TO  51-1-0(1-1.  Fffective  I tVtober  1970,  however,  all  peculiar  supiwrt  equip- 
ment, including  automatic  test  equipment,  is  to  have  an  SHU  identifiable  to  the 
weapon  system  supfx’irted.  Some  air-launched  missile  and  guided  weapon  .AGF 
man-hours  may  be  separately  identified  and  added  as  with  engine  in-shop  work 
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by  seloctinjj  on  tho  last  two  tlin'its  (weapon  system  fH’culiar)  of  the  Kt^CL  codes 
(see  TO  00-20-2,  pas*.  A2-9.  -10.) 


f 


\ 

I 

i 


i 


I 


i 


f 


NOTE:  No  such  capability  exists  for  man- 
hours expended  on  common  AGE  cotied  in  TO  00-25-0(5-2-2,  I’ME  coded  from 
TO  :13K-1-100,  ATE  co<ied  in  TO  51-1-0(5-1,  shop  support,  life  support  equip- 
ment, or  munitions  (TO  llN-series  WUC  manuals). 


ctxle  H) 


2)  Precision  measurement  equipment  (IXJCT 


;5)  Munitions  air  launched  missiles  and  guided 

weapons  (EQCL  cotlo  Y) 

-1)  ECM  polls  (EQCL  codes  A7  through  A79) 

5)  Shop  work  on  local  manufacturers  (EQ('L 
code  S),  including  items  withdrawn  from  supply  stock,  except  engines;  and 
maintenance  of  war  reserve  material,  life  support  equipment,  anil  fonvard  sup- 
port spares. 


3.  Man-hours  for  uploading  and  downloading  weapon 
release  launch  equipment  or  ECM  pixls  for  mission  configuration  or  failure  are 
charged  to  the  aircraft  EQCL  ccxle.  Uploadings  downloadings  for  configviration 
changes  arc  reported  using  support  general  01000  work  unit  code(s),  whereas 
the  weapons  release/launch  equipment  WUCs  from  the  aircraft  W'UC  manual  are 
used  for  upload  download  actions  because  of  failure(s). 

4.  There  is  no  categorization  of  man-hours  bv  scheduled 
or  unscheduled  events  based  on  a standard  grouping  of  type  maintenance  codes. 
Care  should  be  taken  in  selecting  type  maintenance  codes,  if  a man-hour  separ- 
ation into  these  two  categories  is  desired,  to  avoid  confusion  with  the  1)05(5 
values  which  ax-e  based  on  standanl  gi'oupings  of  type  maintenance  codes. 

5.  Unlike  failure  data,  there  is  an  agglomeration  of  on- 
equipment  man-hour  expenditures  by  system,  subsystem,  and  weapon  system, 
and  corresponding  off-equipment  values.  These  values. ai'e  derived  from  the 
MDCS  monthly  transaction  listing,  section  A (On-Equipment,  PCN  SG001B501) 
and  section  B (Off-Equipment,  PCN  SG001B5()2). 

a.  Support  general  data  are  not  included  in  either  of 
these  two  prixlucts.  Such  data  appear  in  section  C (Suppoi't  General, 

PCN  SG001B503). 

b.  TCTO  compliance  man-hours  are  included  in  sec- 
tions A and  B. 

(5.  TCTO  man-hours  ar‘’  included  in  the  monthly  trans- 
action listing,  section  A (On-Equipment,  PCN  SG001B501)  and  section  B (Off- 
Equipment,  PCN  SG001B502),  as  well  as  in  the  MDCS  Work  Sumnxary,  Part  1 
(Direct  Labor  by  End  Item,  PCN  SG001B511)  These  repoi'ts  arc  type- 
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mainteaanco  oriented  ami  include  man-hour  expenditures  eharjjed  to  i'CTt)  type 
maintenance  coiles  T anil  /. 


7.  Abort  data.  No  abort  data  products  or  summaries  are 
pro\ided,  although  abort  occurrences  are  reported. 


S.  No  utilization  or  status  information  is  included. 

9.  tHher  |H?culiarities  clviracteristics  of  the  MDCS  are  as 

follows: 


a.  The  number  of  preflights  need  not  relate  to  number 
of  flights  of  a serial  numbeivd  aircraft.  TO  00-20-2-2,  paragraph  l-17e,  states 
that  support  general  work  by  the  same  crew  indi\idual  on  the  same  tN^ie  of 
equipment  may  be  combined  and  documented  on  the  same  Al-'TO  form  ;I49  using 
appropriate  units  comjdete,  and  the  sei'ial  number  of  the  first  items  inspt'cted 
or  serviced  entered  in  block  3.  Such  use  of  AFTO  form  349  is  limited  to  pre- 
flight, basic  postflight,  end  of  innway  checks,  and  oil  samplings  for  spectro- 
metric  analysis. 


b.  Kach  TCTO  and  Time  Change  Action  performed 
during  an  inspection  will  have  a peculiar  job  control  number  (.K'Nl  assigned. 

c.  Since  documentation  pnvedures  for  look  fix  por- 
tions of  minor  ins[>ections  vary,  analysis  of  the  data  produced  must  be 
approached  with  caution  0 t'*  00-20-2,  paragraph  4-2c(3jf, 

If  For  minor  inspections  (daily,  preflight,  basic 
postflight,  thruflight,  home  station  check,  servicing,  shift  verification,  sched- 
uled storage  inspection,  and  ground  CEM  calendar  inspections  with  an  interval 
of  less  than  seven  daysf,  a ,1CN  is  assigned  for  the  "look"  phase.  Insjx'ctions 
on  same  day  and  for  the  san\e  end  items  may  have  same  JCN.  Each  discrep- 
ancy discovered  during  each  inspection,  however,  will  have  a separate  .ICN 
assigned.  Consequently,  there  is  no  capability  to  identify  the  number  of  dis- 
crepancies discoverd  for  a particular  inspection.  However,  the  average 
discrepancies  found  per  type  inspection  can  be  calculated  using  the  WUC  for  the 
type  inspection  and  units  complete  (for  number  of  inspections),  and  the  numlx'r 
of  discrepancies  (WUCs  in  11-97000  series)  with  the  corresponding  when  dis- 
covered code  (11  for  thruflight;  J for  prefllght;  3 for  home  station  check; 

J for  daily  Inspection/ shift  verification;  E for  storage  Inspection). 

2)  For  phased  Inspections  (hourly  and  calendar),  a 
single  JCN  is  assigned  for  the  "look"  and  "fix"  ohases,  except  that  discrepancies 
discovered  during  an  inspection  and  carried  forward  will  each  have  a distinct 
last  three  digits.  Since  the  first  four  digits  of  the  JCN  identify  the  Julian  date 
(first  three  digits)  and  the  sfx'cific  phase  inspection  (fourth  digit  — A for  1st 
phase,  Z for  24th  pliasc,  2 for  2fith  phase),  m;inual  or  BLIS  arrangement  of  the 
data  can  relate  the  number  of  discrepancies  discovered  during  a Sfx’cific  phase 
inspection  by  aircraft  serial  number,  by  similar  phase  inspections,  or  as  the 
average  for  all  phase  ins|X'ctions.  This  documentation  practice  also  fX'rmits 
analysis  of  discrepancies  corrected  versus  those  carried  forwanl. 
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3)  For  major  inspections,  a similar  practice  is 
used,  i.e. , the  same  JCN  is  assigned  to  both  the  "look”  and  ’’fix”  portions. 

The  fourth  digi  dentifies  the  type  inspection  (similar  to  phased  inspections). 

The  fourth  position  will  be  A for  periodic  inspections  or  ground  CEM  calendar 
inspections  of  seven  days  or  greater;  B for  minor  isochronals;  C for  major  iso- 
chronals;  D for  hourly  postflights.  Like  phased  inspections,  different  last  three 
digits  are  used  for  discrepancies  discovered  during  the  inspection  and  carried 
forward. 


d.  Maintenance  associated  with  the  following  will  not 
be  keypunched  for  MDCS  processing: 

1)  Explosive  Ordnance  Disposal  (EOD)  team  actions 
(reconnaissance,  identification,  rendering  safe,  disposal) 

2)  ICBM  support  general  work  (includes  direct 
support  equipment).  For  ground  CEM  maintained  by  other  than  the  missile 
maintenance  unit,  support  general  work  in  the  03000  and  04000  series  will  be 
processed. 


3)  Ground  CEM  support  general,  except  03000  and 
04000  scheduled  and  special  inspections,  which  will  be  processed 

4)  Nuclear  weapons 

5)  Organizational  exemptions  in  TO  00-20-2, 

attachment  3. 

(7)  Anomalies  Peculiar  to  D056. 

(a)  Computation  of  mean  time  between  maintenance  does  not 
include  any  support  general  work,  even  scheduled  and  special  inspections. 

Also  excluded  are  cannibalizations,  off-equipment  repairs,  NUTS  actions,  and 
action  taken  codes  Q (installation)  and  Y (troubleshoot)  actions.  Actions  related 
to  tanks,  racks,  etc. , will  be  included  if  these  items  have  work  unit  codes. 

(b)  Computation  of  mean  time  between  failure  does  not  include 
type  2 failures  (externally  induced),  and  therefore  their  effect  on  operational 
reliability  and  their  demand  on  maintenance  and  supply  resources  are  not 
recognized. 

(c)  Action  taken  code  G (repairs  and  replacements  of  minor 
parts)  is  not  used  to  aggregate  failure  data  below  the  system/subsystem  level. 
This  current  D056  procedure  for  computing  MTBF  for  components  overstates 
the  MTBF  value,  i.e. , makes  component  reliability  appear  better  than  it 
really  is. 

(d)  The  true  MTBF  value  is  slightly  understated  because  of 
delays  between  the  removal  of  components  and  completion  of  bench  check  for 
action  taken  code  B events  (bench  checked  serviceable).  This  occurs  because 
off-equipment  action  taken  code  B events  are  subtracted  monthly  from 
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on-oquipment  action  taken  codes  P ami  R by  matchint::  type  equipment,  ALt', 
MOS,  WUC',  base  code,  and  job  control  numbers  for  the  on-  and  off-equipment 
actions.  When  a delay  occurs  there  will  be  no  match  and  the  on-equipment 
action  will  be  recorded  as  a true  failure,  thus  understating  the  MTBF  to  some 
degree. 


(e)  MT’Bl'  values  are  not  computetl  and  provided  for  the  original 
weapon  system. 

(f)  Diffi'i'cnces  between  MOCS  and  DonCt  failure  definitions  are 
discussed  under  paragraph  ■l-5a(())(a). 

(g)  In  computing  man-hours  per  flying  hour,  some  005(5  reixirts 
excUuie  all  support  general  work  unit  codes,  including  0:i  (scheduled  insfu'etions) 
and  04  (special  inspections).  Also  excluded  are  man-ln)urs  consumeii  on  items 
withdrawn  from  supply  (when  discovered  code  Y).  'I'he  OOr)()Br)()25  product  is 
the  best  source  of  Mil  l'll  data.  However,  support  general  hours  are  incom- 
plete since  only  OilXXX  and  OIXXX  WUC  data  are  reported  to  AFLC. 

(h)  The  nO5()B5()0()  and  nor)0Br)02r>  include  some  support  general 
work,  but  D05fiB5527  does  not.  Further,  DOStJBSOOO  includes  programmed 
depot  maintenance  man-hours  in  the  "shop”  column.  Depot  man-hours  are  sep- 
arately shown  in  the  DDr)(5Br>025  report.  Although  the  forewords  to  Dt^PifiBSOOd 
and  5{)25  (dated  31  (October  1073  and  I March  1970,  respe('tively)  state  other- 
wise, type  maintenance  cmies  for  unscheduled  man-hours  are  B,  S,  ami  Y for 
aircraft,  and  B,  F,  L,  S,  W,  X,  and  Y for  engines.  All  other  type  mainte- 
nance codes  apply  to  the  scheduled  man-hours.  Support  general  WUt'  03XXX 
arc  scheduled,  OIXXX  are  unscheduled.  TCTO  labor  is  slunvn  separatidy  in  the 
005635025  neither  as  schetluled  nor  unscheduled. 

NOTlv.  Although  not  specifically  excluded,  type  maintenance 
codes  ,1  and  Q data  will  not  be  included  because  the  IXJCF  codes  for  this  tyjH'  of 
work  will  vary  from  the  weapon  system  FQCL  code  to  wliich  the  ntl56B5006  and 
nO56B5025  apply. 

(i)  Abort  rates  as  reported  on  DO56B5015  and  5527  for  a weapon 
system  can  be  overstated  since  more  than  one  WUC  may  be  reportcii  for  a single 
abort.  Also,  "number  of  sorties  flown"  docs  not  reflect  attempted  sorties. 

Total  attempted  sorties  should  inchule  sorties  flown  plus  sorties  on  which  a 
when  discovered  code  A (before  flight  aboi't)  was  reported.  I'his  anomaly  over- 
states the  abort  rate.  Neither  the  l)l)56B5527  nor  the  DC5(!B500(!  and 
D056B5007  products  are  satisfactory  sources  for  abort  rate  data  for  an  oxcrall 
weapons  system.  If  available,  the  Dt)56B50l5  products  for  an  overall  MIH'S 
may  be  of  some  value  for  comparison  (uirposes  of  alwrts  fx'r  1000  sorties. 

b.  Data  Systems  Description. 

Paragraphs  4-5b(l)  through  (10)  describe  data  systems  aiipUcable  to 
the  evaluation  of  reliability,  maintainability,  availability,  and  life  cycle  costing 
of  Air  Force  weapon  systems  and  equipment  during  OT&K.  The  data  systems, 
which  include  both  data  collection  and  management,  are  described  relative  to 


their  objectives,  policy,  and  procedural  documentation;  data  collection  forms 
and/or  data  sources;  associated  automated  data  system  (ADS)  output  products; 
and  interfaces  with  other  data  systems.  Where  applicable,  related  appendixes 
discuss  the  equations  and  algorithms  used  in  the  respective  computer  programs 
to  obtain  resulting  logistics  parameters  and/or  measures  of  effectiveness  such 
as  mean  time  between  failures,  man-hours  per  flight  hour,  etc.  The  appendixes 
also  contain  samples  of  the  output  products.  The  automated  data  processing 
systems  discussed  include; 

— Maintenance  Data  Collection  (MDC)  System 

— Maintenance  Cost  System  (MCS) 

— Aerospace  Vehicle  and  Equipment  Inventory,  Status,  and 
Utilization  Reporting  System  (AFR  65-110) 

— Product  Performance  System  (DOSG) 

— Increase  Reliability  of  Operational  Systems  (IROS),  K051 

— Engine  Management  Products  (D024) 

— Standard  Base  Supply  System  (U1050-II) 

— Base  Level  Inquiry  Systems  (BLIS) 

— Machine  Independent  System  Effectiveness  Data  System  (MISEDS) 

— Maintenance  Management  Information  Control  System  (MMICS). 

(1)  Maintenance  Data  Collection  (MDC)  System. 

(a)  Objective. 

Objectives  of  the  MDC  System  are  to  provide  a means  for 
collecting,  storing,  and  retrieving  base-level  maintenance  production  data  for 
use  on  the  base  where  the  data  are  collected,  and  for  use  off  the  base  by  USAF/ 
PRM  (manpower),  USAF  Accounting  and  Finance,  AFLC,  and  other  Major 
Commands. 

1.  On  base,  base  managers  and  supervisors  can  retrieve 
data  of  the  following  nature; 

a.  Production  information  about  the  type  of  work 
accomplished,  the  work  center  that  performed  the  job,  and  the  equipment  on 
which  the  work  was  accomplished. 

b.  Equipment  maintenance  schedules  and  inventory 
information  for  maintenance  actions  required  on  a calendar  basis. 

c.  Productive  direct  labor  and  productive  indirect 
labor  hour  expenditures  in  cither  detailed  or  summary  form.  This  includes 
labor  expended  to  support  other  organizations  or  special  projects. 
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d.  Equipment  failures  and  discrepancy  information. 

This  information  is  available  in  composite  form  by  type  of  equipment  and  for 
individual  equipment  items. 

e.  Configuration  status  accounting  Information  concern- 
ing modifications  that  have  been  completed  and  those  that  are  partially 
completed. 


2.  Off  base,  the  intended  use  of  the  data  within  the  MDC 
System  (and  composite  data  from  interfaces  with  other  data  systems)  is  for 
information  to  control  various  programs  established  by  Air  F'orce  and  Major 
Command  regulations  and  manuals.  MDC  System  data  can  be  used  to; 


a.  Identify  maintainability  and  reliability  problems  of 

Air  Force  equipment. 


actions. 


b.  Establish  priorities  for  product  improvement 


c.  Account  for  modifications  to  Air  Force  equipment 
and  evaluate  the  effectiveness  of  modifications. 


d.  Validate  inspections  and  time  change  requirements 

and  intervals. 

e.  Identify  safety  deficiencies  and  monitor  their 

corrective  actions. 


requirements. 

data. 


f.  Validate  or  adjust  calibration  intervals. 

Validate  spares  requirements. 

h.  Identify  programmed  depot  maintenance 

i.  Compile  maintenance  man-hours  per  flying  hour 


j.  Evaluate  unsatisfactory  material  reports  and  modi- 
fication proposals  from  other  commands  or  Industry. 


k.  Compute  the  cost  for  billing  the  Military  Airlift 
Command  and  the  Air  National  Guard  for  reimbursable  depot  level  maintenance. 


1. 

distribution  requirements 


Determine  Time  Compliance  Technical  Order  kit 
and  TCTO  reclsion  date. 


3.  Additioaally  off-base,  AFLC  provides; 

a.  In  conjunction  with  AFSC,  data  on  the  performance 
and  support  requirements  of  current  Inventory  equipment  for  industry  to  use  in 
developing  new  systems  and  equipment. 

b.  Data  for  reports  by  Headquarters  USAF,  the 
Departments  of  the  Army  and  Navy,  the  Inspector  General  (for  accident  investi- 
gation), and  the  Major  Commands. 

£.  Data  on  computer  tapes  to  Major  Commands  requir- 
ing comparable  data  as  used  by  AFLC. 

d.  Data  on  Air  Force-wide  repair  capability  to  bases. 
Major  Commands,  and  Headquarters  USAF  for  the  assessment  and  Improvement 
of  maintenance  repair  capabilities. 

4.  Besides  AFLC,  the  data  in  the  MDC  system  is  intended 
for  other  off-base  users  such  as: 

i a.  Major  Commands  to  determine  the  status  of 

equipment  modifications. 

b.  Headquarters  USAF/PRM  and  Major  Commands  for 
validating  manpower  requirements. 

c.  Headquarters  USAF  and  the  Accounting  and  Finance 

I Center  for  determining  the  cost  of  base  level  maintenance  operations. 

(b)  Policy  and  Procedural  Documentation  for  MDC. 

U AFM  66-1,  Maintenance  Management.  This  manual 
establishes  the  maintenance  management  system  applicable  to  all  Air  Force  and 
Air  National  Guard  activities  engaged  In  the  maintenance  of  aircraft,  missiles, 

' munitions,  AGE,  avionics,  training  equipment,  and  CEM  equipment.  AFM  66-1 

contains  12  volumes  presenting  specific  guidance  tailored  for  major  functional 
areas. 

2.  AFM  66-267,  Maintenance  Data  Collection  System. 

This  manual  provides  the  rules  for  the  operation  of  the  MDC  System  on  the 
B3500  computer.  It  provides  an  overview  of  the  entire  system,  gives  Initial 
implementation  instructions,  and  outlines  normal  day-to-day  operations.  All 
^ ou^ut  products  are  described  and  a sample  of  each  output  product  is  presented 

i In  Chapter  5 of  AFM  66-267  (reproduced  as  appendix  4-5A).  The  use  of  the 

; *'  Base  Level  Inquiry  System  (BLIS)  in  conjunction  with  the  MDC  is  described 

I in  Chapter  6 of  AFM  66-267. 


1 
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AKM  171-2R7,  Automatic  Data  Professing;'  Systems  a»(l 
Procedures.  This  manual  provides  B3500  computer  information  tor  processing 
MDC  System  data  utlllzinK  the  (IOOIB/BD  Automatic  Data  System. 

Technical  Order  00-20-2  Series,  The  Maintenance  Data 
Collection  System.  The  TO  00-20-2  series  provides  detailed  information  on  the 
maintenance  data  collection  procedures  for  on-equlpment,  off-equipment,  and 
"productive  indirect"  hours.  The  series  describes  in  detail  how  to  fill  out  the 
associated  data  collection  forms. 

(c)  Data  Collection  Forms/Pata  Sources  for  MDC  System. 

1..  Data  forms:  AFTO  form  3-19,  "Maintenance  Data 
Collection  Itecord,"  and  the  AFTO  form  350,  "Reparable  Item  I’rocessinp,  Taj^, " 
arc  the  basic  data  collection  source  documents  used  with  the  MDC  System. 

a.  AFTO  form  3*19  is  the  single  raw  data  source  docu- 
ment used  to  transcribe  data  onto  keypiuiched  cards  for  input  to  the  associated 
ADS.  The  TO  00-20-2  series  describes  completely  the  uses  of  the  AFTO  form 
349  for  each  class  of  equipment  and  for  non-MDC  appllcatii>ns. 

b.  AFTO  form  350  serves  as  the  common  Ixmd  between 
maintenance  and  supply.  When  a demand  is  made  from  supply  for  a replacement 
I'epair  cycle  item,  a supply  document  number  is  obtained  fiom  supply  and 
recoi*ded  on  the  AFTO  form  350  (blocks  13,  10).  This  form  interfaces  the  MDC 
System  with  the  Standard  Base  Level  Supply  System  (U1050-11).  The  TO  00-20-2 
series  describes  in  detail  the  use  of  AFTO  form  350. 

(d)  Automatic  Data  Processing  System  Used  by  the  MDC  System. 


rf 
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TABLE  4-5d.  TABLE  OF  OUTPUT  PItODUCTS  FROM  GOOIB/BD  MAINTENANCE  i 


DATA  COLLECTION  SYSTEM  (Sheet  1 of  4) 


Product  Control 
Number 

Title 

Applicable 
Paragraph, 
AFM  fi7-2fi7» 

SC.OOlBOll 

MDC  History  Change  Idstlng 

SG001B012 

MDC  History  Change  Error  Listing 

SC.001B032 

MDC  Chief  of  Maintenance  History  Transfer 
Listing 

SG001B033 

MDC  Chief  of  Maintenance  History  Purge 
Listing 

SG001B121 

MDC  Master  ID  Error  Listing 

3-4 

SG001B122 

MDC  Master  ID  Update  Listing 

5-5 

SG001B123 

MDC  Master  ID  Error  Card 

5-4 

SG001B132 

MDC  Master  ID  Request  Error  Card 

5-fi 

SG001B151 

MDC  Master  ID  Ijlstlng  by  ID  Number 

5-7 

SG001B152 

MDC  Master  ID  Listing  by  OWC 

5-7 

SG001B153 

MDC  Master  ID  Idstlng  by  End  Item 

5-7 

SG001B154 

MDC  Master  ID  Listing  by  PWC 

5-7 

SG001B162 

MDC  Equipment  Schedule  Part  1 by  PWC 

5 -8a 

SC.001B163 

MDC  Equipment  Schedule  Part  2 by  OWC 

5- 8a 

SG001B164 

PME  General  Purpose  Cards 

5-8c 

SG001B172 

MDC  Organizational  Master  Record  Update 
Listing 

5-9 

SG001B181 

MDC  Master  File  Invalid  Data 

5- 10a 

SC.001B183 

MDC  Master  File  Invalid  Data  Add  Cards 

5- 10c 

SCA)01B302 

MDC  Dally  Transaction  Error  Listing 

5-11 

SG001B303 

MDC  Dally  Transaction  Error  Cards 

5-11 

SCX)01B304 

MDC  Schedule  Update  Listing 

5-12 

♦See  appendix  4-5A. 
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TABLK  -l-Sd.  (Sheet  2 of  4) 

Product  Control 
Number 

Title 

Applicable 
Paragraph, 
AFM  67-2r.7* 

SC.001B321 

MDC  Polly  Transaction  Listing  Section  A 
(On-Kqulpment) 

r>-13c(l) 

SC.001B322 

MPC  Pally  Transaction  Listing  Section  B 
(Gff-Kqulpnient) 

r>-13c(2) 

SG001B323 

MPC  Pally  Transaction  Listing  Section  C 
(Support  General) 

r.-13c(3) 

SC.001B324 

MPC  Pally  Transaction  Listing  St'ctlon  P 
(Indirect  Labor) 

r)-13c(4) 

SG001B325 

MPC  Pally  Transaction  Listing  Section  K 
(Parts  Ueplaced) 

5-13c(5) 

SG001B32fi 

MPC  Pally  Transaction  Listing  Section  F 
(Serially-Controlled  and  Time  Change 

Hemove  and  Ueplace) 

r)-i3c(fi) 

SG001B327 

MPC  Pally  Transaction  Listing  Section  G 
(Engine  Boom  and  Ueplace) 

r)-13c(7) 

SC.001B501 

MPC  Monthly  Transaction  Listing  Section  A 
(Gn-Equipment) 

r.-14a(l) 

SG001B502 

MPC  Monthly  Transaction  Listing  Section  B 
(Gff-Equipment) 

r>-14a(2) 

SG001BS03 

MPC  Monthly  Transaction  Listing  Section  C 
(Support  General) 

r>-14a(3) 

SC.001B504 

MPC  Monthly  Transaction  Listing  St'ctlon  P 
(Indirect  Labor) 

5-I4a(4) 

SG00XB50‘5 

MPC  Monthly  Transaction  Listing  Section  K 
(Parts  Ueplaced) 

5- 14a  (5) 

SGOOlBSOfi 

MPC  Monthly  Transaction  Listing  Section  F 
(Serially-Controlled  and  Time  Change 

Uemove  ami  Ueplace) 

5- 14a  (6) 

SG001B507 

MPC  Monthly  Transaction  l.lsting  Section  G 
(Engine  Uemove  and  Replace) 

5-l4a(7) 

SG001B5U 

MPC  Work  Summary  Part  1 (Direct  Labor  by 
End  Item) 

5-15a 

4-18fi 
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TABLE  4-5d.  (Sheet  3 of  4) 


Product  Control 
Number 

Title 

Applicable 
ParaRraph, 
AFM  r.7-2f.7* 

SC001B521 

MDC  Work  Summary  Part  2 Section  A (Blrect 
Labor  by  Workcenter,  1 Pos) 

5- 15b 

S(1001B522 

MOC  Work  Summary  Part  2 Section  B (Blrect 
l.abc^r  by  Workcenter,  2 Pos) 

5-15h 

SC.001Br>23 

MDC  Work  Summary  Part  2 Section  C (Direct 
l.abor  by  Workcenter,  3 Pos) 

5-15h 

SG001B32r) 

MDC  Work  Summary  Part  2 Section  D (Direct 
Labor  by  Workcenter,  5 Pos) 

5- 15b 

SC.001Br)31 

MDC  Work  Summary  Part  3 Section  A 
(Indirect  Labor  by  Workcenter,  1 Pos) 

5- 15c 

SG001B532 

MDC  Work  Summary  Part  3 Section  B 
(Indirect  Labor  by  Workcenter,  2 Pos) 

5- 15c 

SG001B533 

MDC  Work  Summary  Part  3 Section  C 
(Indirect  Labor  by  Workcenter,  3 Pos) 

5-15c 

SG001B535 

MDC  Work  Summary  Part  3 Section  D 
(Indirect  l^abor  by  Workcenter,  5 Pos) 

5- 15c 

SC4)01B53f) 

MDC  Activity  Identifier  Summary  Part  2 
(Indirect  Labor) 

5- 15c 

SG001Br)41 

MDC  Activity  Identifier  Summary  Part  1 by 

PWC 

5- Ida 

SG001B542 

MDC  Activity  Identifier  Summary  Part  2 by 
Activity  Identifier 

5-lfia 

SG001B732 

WUC  Trend  Analysis  Report 

5- 17a 

SC4)01B734 

Part  Number  Trend  Analysis  Report 

5-17h 

SG001B735 

Trend  Analysis  Request  Error  LIstlnR 

5- 17c 

SG001B749 

Performance  MonltorlnR  Master  ChanRc 

Llstlnp 

5-17d 

Sr4)01B771 

(^-Equipment  Performance  UlRhllphts 

5-17e 

Sr4)01B772 

Off-Equipment  Performance  UlRhllRhts 

5-17f 

SC.001B781 

lllKh-25  On-Equipment  Failures 
^ 

5-17r 
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TAULK  -J-Sil.  (Sheet  -1  of  4) 


Product  Control 
Numb«»r 

Title 

Applicable 

ParnKraph, 

A EM  fi7-2f.7» 

S(;001B791 

lUKh-2r>  Man-lUnjr  Consuming  Jobs 

r.-17h 

sr.ooinsii 

Workloiul  PistrilHJtion  Input  Uoqucst  Krror 

List 

r)-lSa 

sc.ooinsi2 

Workloail  Distribution  llistoKram  AvoraRC 
Number  of  Workers  by  Hour  of  Day 

5-1  Ha 

sCiOOiRsia 

Workload  Distribution  Histogram  PriKluctivc 
Man-Hours  by  Hour  of  Day 

r>-18a 

SC.001RS14 

Workload  Distribution  Histoffram  PrtHiuctivc 
Man-Hours  by  Day  of  Month 

5-lSd 

SC001R815 

Workload  Saturation  Clmrt  Man-Hmirs  by 

Hour  of  Day 

5-l8e 

SCiOOlBHlO 

Workload  Saturation  Chart  Man-Hours  by 

Day  of  Month 

5-18e 

HCS;HX'.-MA(AR) 

7411 

MDC  Depot  Equipment  Additlon/Deletion 

List 

n-7b(2)  (c> 

r 


I 


(f)  MDC  System  GOOIR/BD  ADS  Interfaces. 

The  MDC  Systom  GOOin/nn  Automatic  Data  System  inter- 
faces with  the  Product  Performance  System.  The  IXiSfi  Product  Perform- 

ance System  ADS  utilizes  the  B3500  command  level  computer.  The  Inputs  to 
D05B  Include  the  report  UCS;  LOG-MMO  (All)  7142  from  the  Maintenance  Data 
Collection  System  GOOIB/BD,  which  is  forwarded  to  AFLC  and  MAJCOMs. 
Subsection  4-5b(4)  discusses  the  IXififi  system  in  detail. 

(2>  Maintenance  Cost  System  (MCS). 

(a)  Objectives  - Objectives  of  the  Maintenance  Cost  System  are: 

U To  provide  a cost  system  for  base  level  activities  per- 
forming organizational  and  intermediate  maintenance. 

2.  To  permit  the  consolidation  of  both  depot  and  base  level 
maintenance  costs  into  one  report  showing  total  Air  Force  maintenance  cost. 

£.  To  improve  Office  of  the  Secretary  of  Defense  (OSD)/ 
USAF  responsiveness  to  Office  of  Management  of  the  Budget  (OMB)  and  Congress 
regarding  total  maintenance  cost. 

4.  To  provide  data  for  life  cycle  costing. 

5.  To  improve  the  basis  for  determining  whether  to  perform 
maintenance  contractually  or  in-house. 

To  improve  data  on  base  level  maintenance  cost  per 

flying  hour. 

7.  To  purify  program  element  reporting  for  the  fi-year 
force  structure  and  Air  Force  budget  submission. 

8.  To  provide  cost  controls  over  total  maintenance  lalior 
expenditures  (direct,  indirect,  or  overtime). 

(b)  Policy  and  Procedural  Documentation  for  the  Maintenance 

Cost  System. 

AFM  177-380,  USAF  Standard  Base  Level  Maintenance 
Cost  System,  prescribes  standard  procedures  for  reporting  at  the  base  level  on 
the  maintenance  cost  systems  employed  on  the  BOSOO  computer.  The  manual 
applies  to  all  base  level  Accounting  and  Finance  Offices  (AFtis)  whose  accounts 
and  Maintenance  Data  Collection  Systems  are  maintained  on  the  B3500  computer, 
and  where  the  Standard  Base  Supply  System  (SBSS)  Is  maintained  on  the 
U1050-II.  AFM  177-380  has  been  developed  primarily  as  a functional  user  sup- 
port manual  for  the  MCS. 

2.  AFM  171-380,  Base  Level  Maintenance  Cost  System 
(B3500).  AFM  171-380  is  the  data  automation  counterpart  manual  to 


1 
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AFM  177-380.  It  proviries  instructions  for  data  automation  personnel  to  process 
all  of  the  accountlnR  applications  and  to  provide  the  output  products  of  the  MCS. 

(c)  Data  Collection  Forms/Data  Sources. 


The  MCS  receives  Inputs  from  two  classes  of  source  data; 
punched  cards  and  maRnetic  tape.  The  UlOSO-II  SBSS  and  the  engine  manager 
provide  MCS  Information  by  pimchcd  cards.  The  Maintenance  Data  Collection 
System,  Maintenance  Management  Information  Control  System,  and  the  Account- 
ing and  Finance  Systems  supply  MCS  information  by  magnetic  tape. 

(d)  ADD  System  Employed  by  MCS. 

The  Automatic  Data  System  employed  by  the  Maintenance 
Cost  System  Is  the  H129A^S. 

(e)  Output  Products  and  Reports  of  the  Base  Level  Maintenance 
Cost  System  (B3.'>00)  ADS. 

1.  The  base  level  MCS  reports  provide  the  chief  of  mainte- 
nance with  cost  data"  for  analysis.  Isolation,  and  control  of  the  cost  resources 
consumed  In  the  maintenance  operation.  The  reports  are  cost  (expense) 

i oriented,  meaning  that  the  costs  are  measured  by  use  and  consumption  of 

1 resources  rather  than  by  assignment  of  resources  or  by  obligation  of  funds.  Six 

I reports  are  produced  from  the  MCS. 

i 

1 2.  Table  l-Se  provides  a listing  of  the  MCS  output  reports 

giving  the  title,  report  control  symbol  (UCS),  report  number,  and  the  reference 
paragraphs  in  chapter  15  of  AFM  177-380  where  a description  of  the  report  can 
be  found.  Chapter  15  of  AFM  177-380  Is  reproduced  as  appendix  4-5n. 

(0  MCS  Interfaces  with  other  ADSs  as  follows; 

General  Accounting  System. 

a.  The  General  Accuonting  System  provides  cost  data 
to  the  MCS  monthly  for  each  maintenance  organization.  These  costs,  such  as 
TDY,  contractual  service.  Contractor  Operated  Parts  Store/Contractor 
Operated  Civil  Engineering  Store  (COPAItS/COCESS) , and  AVGAS  non-fly 
(AVGAS  used  for  other  than  flight,  e.g. , engine  run-up  during  maintenance)  and 
i programmatically  are  distributed  to  Mission  Design  Series  (MDS)  on  a percent- 

! age  of  direct  productive  man-hours  used. 

j b.  The  General  Accounting  System  pi-ovldes  an  extract 

tape  which  Is  Input  to  the  MCS  interface  program.  The  monthly  extract  tape  is 
produced  automatically  during  end-of-month  processing.  A listing  of  the 
transactions  contained  on  the  tape  Is  available  as  "A&F  (Accounting  & Finance) 
Monthly  MCS  Extract  Lists,"  PCN  N3470554. 

2.  MCS  Interface  with  Maintenance  Data  Collection 
System  (MDCS)  - The  MDCS  provides  the  MCS  with  actual  Air  Force 
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TABLE  4-r)0.  MAINTENANCE  COST  SYSTEM  OUTPUT  REPORTS 


Report  No. , RCS 
RAF-ACF(M)7403 

Title 

Applieable 

Paragraph, 

AFM-177-3M0* 

lA 

(irj;ani/ational  and  Intermediate  Maintenance 
Cost  Report  - WBS  Within  MBS  Within  I'FC 

ir..4 

IB 

Cii'Kanl/ational  and  Intermediate  Maintenance 
Cost  Report  - Non-MDS  by  WBS 

15.5 

2A 

(Organizational  and  Intermediate  Maintenance 
Cost  Iteport  - WAC  Within  MU  Within  1>KC 

15.0 

2B 

Organizational  and  Intermediate  Maintenance 
Cost  Iteport  — Non-MDS  by  WAC 

15.  7 

.3 

(Organizational  and  Intermediate  Maintenance 
Cost  Report  — by  Indirect  Productive  LaUir 
Category 

15.8 

4 

(Organizational  and  Intermediate  Maintenance 
Cost  Report  — by  Indirect  Non-Productive 
Category 

15.9 

r. 

(Organizational  and  Intermediate  Maintenance 
Cost  Report  - by  Material  Category 

15.  10 

fi 

Organizational  and  Intermediate  Maintenance 
Cost  Report  — by  Customer 

15.  11 

•See  appendix  4-5n, 

maintenance  man-hour  ilata  by  Mission  Design  Series  (MDSi,  Workload  Break- 
down Structure  (WBS),  Work  Accomplished  Code  (WACi,  etc.  This  information, 
provided  by  tape  with  report  control  symbol  RCS:HAF-MMO(AR)  7112,  is  input 
on  MCS  monthly. 

3.  MCS  Interface  with  the  MMICS  Administrath  e Subsystem  ' 
Exception  Time  Accounting  System  (ETA)  - The  MMICS  administrative  sub- 
system  and  the  ETA  provide  the  MCS  with  Information  relating  to  available 
maintenance  man-hours.  This  Information  is  provided  on  tape  each  month. 

(Note:  Bases  still  operating  on  MMICS  increment  1 will  report  to  MCS  from  the 
MMICS  administrative  subsystem.) 

4.  MCS  Interface  with  MMICS  Status  Subsystem/Aerospace 


Vehicle  Status  Report  (Al)  — The  MMICS  Status  Subsystem/Aerospace  Vehicle 
Status  Report  (Al)  provides  the  MCS  actual  monthly  and  fiscal  year-to-date 
flying  hours  by  aircraft  MDS.  The  input  to  MCS  is  made  by  tape  monthly. 
(Note:  Bases  on  Increment  1 of  MMICS  report  to  MCS  using  the  .Aerospace 
Vehicle  Status  Report  (Al).  Bases  on  Increment  2 of  MMICS  report  to  MCS 
using  the  MMICS  status  subsystem.) 
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MCS  Interface  with  the  Standard  Base  Level  Supply 
System,  U1050-II  ~ Daily,  the  SBSS  produces  detailed  material  transaction 
cards  for  input  to  MCS.  These  transaction  cards  are  processed  by  the  MCS  to 
accumulate  both  direct  (funded  and  unfunded)  and  indirect  material  costs. 

MCS  Inputs  from  Rase  Kngine  Manager  — The  MCS  must 
provide  for  costing  exchanm*  material  consumed  while  performing  maintenance 
at  the  installation  level.  When  a reparable  investment  item  (for  example,  the 
J79  engine)  is  sent  to  AFLC  as  NltTS,  the  appropriate  aircraft  Mission  Design 
Series  is  charged  20  percent  of  the  stock  price  list.  Kxchange  material  con- 
sumed during  the  repair  of  an  engine  is  provided  through  the  Standard  Base 
Supply  System  (SBSS).  Since  whole  er  :ines  are  not  included  in  the  SBSS,  they 
must  be  controlled  and  costed  based  on  input  from  the  base  engine  manager. 

The  base  engine  manager  provides  engine  detail  cards  to  the  MCS  manager 
monthly. 

7.  MCS  Inputs  from  Base  Level  Civilian  I’ay  System  - The 
base  level  civilian  pay  sysU'm  provides  leave  data  on  civilian  personnel 
assigned  to  maintenance  organizations  so  that  the  total  leave  cost  can  be  entered 
in  the  MCS.  The  method  for  costing  civilian  accrued  annual  leave  in  the  base 
level  MCS  requires  that  computations  be  made  annually  from  payroll  records  as 
of  the  end  of  the  fiscal  year  for  the  amount  of  change  in  the  unused  balance  of 
accrued  annual  leave.  The  amount  is  costed  to  MDS/non-MDS  based  on  direct 
labor  hours  used  for  that  weapon/support  system. 

(3)  Aerospace  Vehicle  and  Equipment  Inventoi-y,  Status,  and 
Utilization  Reporting  Systems  (AFR  65-110) . 

(a)  Objectives  — Objectives  of  the  Aerospace  Vehicle  and  Equip- 
ment Inventory,  Status  and  Utilization  Reporting  System  are  to  provide  basic 
historical  management  information  to  all  levels  of  command,  and  provide  indi- 
cations of  equipment  capability  and  performance  summarized  over  a period  of 
time.  Specifically,  the  Information  contained  in  the  resulting  output  products  is 
used; 

To  provide  the  official  Air  Force  inventory  (except  CEM) 
and  condition  status  data  for  the  equipment  reported. 

2.  To  develop  the  Air  Force  programming  documents  and 
their  related  budget  and  manning  requirements. 

3.  To  prepare  statistical  analyses  for  congressional 
committees,  the  Office  of  Management  and  Budget,  and  the  Department  of 
Defense. 

4.  With  the  Maintenance  Data  Collection  system  in  comput- 
ing mean  time  between  failures  and  other  logistical  assessment  parameters. 

5.  As  an  Input  to  the  Aircraft  Maintenance  Manpower 
Information  Systems. 
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Cost  System. 


To  provide  listings  ol'  the  data  input  to  the  Maintenanee 


(b)  Poliey  and  I’roeedural  Doeumentation  for  the  Aerospace 
Vehicle  and  Kquipment  Inventory,  Status,  and  lTtlli/-ati(m  Iteportin;;  System. 

1^.  AFR  05-110,  Standard  Aerospaet'  Vehiele  and  F'quipment 
Inventory,  Status,  and  Utili/.ation  lleportin);.  'I’his  manual  estal)Iishes  standard 
requirements  for  reportin^j  inventory,  status,  and  utilization  of  selected  Air 
Forei*  aerospace  equipment.  Specific  individ\ial  requirements  are  prescrilu'd 
for: 


a.  At'i'ospace  vehicle  inventory  and  status  repoi’tinp; 

b.  Aircraft  utilization  reportinfj 

e.  CFM  status  and  inventory  reporlinn 


reporting. 


d.  Trainer  equipment  inventory,  utilization,  and  status 


2.  Al'’M  fir)-2r)0.  Aerospace  Vehicle  Inventory,  Status,  and 
Utilization  lleportinK.  AFM  rir)-2n0,  used  in  conjunction  with  AFR  fiH-llO,  pro- 
vides the  documentation  necessary  for  the  functional  an'a  personnel  beinj^  sup- 
ported by  the  R-.lfjOO,  R-.‘5r>2,  and  Il-fiOOO  computers.  It  contains  procedures  for 
establishment  and  use  of  the  Aerospace  Vehicle  Inventory,  Status,  and  Utilization 
UeportlnR  System  on  the  U-2()2  and  B-^.lOO  at  base  level,  and  the  R-2r)00  and 
M-fiOOO  computers  at  command  level.  It  and  chapter  2 of  AFR  nfi-llfl  pertain  to 
inventory  and  status  reporting:.  Chapter  2 of  AFR  (IH-llO  is  used  in  conjunction 
with  AFM  f)r)-2()()  for  utilization  reportlnp. 


AFM  171-200,  Aerospace  Vehicle  Status  Iteportinu 
System  C022A/AW  (Volumes  t and  IQ.  This  ?nanual  provides  opi'ratinp:  pro- 
cedures for  reportinf?  inventory,  status,  and  utilization  of  aerospace  vehicles  to 
processing  organizations,  Ma  jor  Commands,  and  AFT,C  on  the  (1022A/AW  auto- 
matic data  system  employed  on  the  B-llfiOO  and  Il-dOOO  computers. 


4,  AFM  rir)-2rir).  Communications  - Klcctronlcs  - 
Meteorological  (CFM)  Status  Reporting.  AFM  (>r)-2nr)  describes  and  establishes 
the  procedures  for  the  standard  CFM  Kquipment  Status  and  Inventory  Reporting 
System.  It  contains  data  processing  instructions  for  the  functional  managers 
receiving  computer  sup|)ort.  i'rocedures  for  preparing  and  submitting  Air 
Force  form  2445,  "Job  Control  Document”,  or  Air  Force  form  182,  "Kquipment 
Status  Report",  are  provided.  It  also  provides  the  standai'd  sam()le  ret)ort 
formats  on  CF’M  status  reporting  at  all  levels  of  command. 

5.  AFM  171-205,  Cround  CKM  Kquipment  Reporting 
System,  CiOn.lK/Dn  (Volumes  1 and  11).  This  manual  provi des  operating  p r o - 
cedures  for  reporting  status  and  inventory  of  ground  CKM  equipment  to 
processing  organizations.  Major  Commands,  and  AFl.C  on  the  (;o.'12K/HU  auto- 
matic data  system  employed  on  the  11-2500  base  level  computer. 
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(!.  AFM  (ir>-272,  Trainer  Kqulpment,  Inventory  Utilisation 
and  Status  Ruport  System  - AFM  ()r>-272  contains  Ihu  necessary  dociimontalion 
and  data  processing:  instructions  for  use  by  the  functional  area  personnel 
receiving  base  level  support  on  the  n-ShOO  and  B-2fi3  computer  system.  It 
establishes  the  procedures  and  standards  necessary  for  preparing  and  submitting 
Air  Koree  form  .159  for  processing,  and  provides  Inpvit  formats  and  descriptions 
of  output  products. 

7.  AV’M  171-272,  Trainer  Equipment,  Inventory  UtUly.ntlon 
and  Status  Reporting  System  (R-:i.500)  (lOtllCl/lU  (Volumes  1 and  11).  This  manual 
provides  operating  proceilures  for  reporting  inventory,  status,  and  utill/.ation  of 
selected  trainers/training  equipment  to  processing  organizations,  and  AFLC. 

The  ADS  described  Is  the  G0;i;K'./B1,  employed  on  the  B-:i500  computer. 

(c)  Data  Collection  Korms  and  Data  Sources. 

Data  Collection  Forms. 

a.  Air  I’oree  form  259,  "Aerospace  Vehicle  Data, 
Card",’*'  is  used  to  record  utilization  and  changes  in  status  and  inventory  of 
aerospace  vehicles  on  a daily  basis  at  each  unit  supported  by  a l)ase  processing 
a B-2.500  computer.  This  form  Is  also  used  for  the  recording  of  utilization, 
status,  and  inventory  change  of  trainer  equipment. 

b.  Air  Force  form  .159a,  "Aerospace  N'ehiele  Data 
Manual",*  Is  used  when~manual  reporting  is  required,  l.e. , the  base/unlt  Is  not 
supported  by  a B-.1500  computer.  These  source  documents  are  subsequently 
forwarded  to  a designated  supporting  activity  in  accordance  with  AFR  11— 1. 

e.  AFTO  form  781  series,  "Aerospace  Vehicle  Flight 
Data  Document",  contains  the  source  documents  for  recording  and  reporting 
operational  flight  information  for  each  aircraft  that  participates  In  a flying 
mission.  The  Information  contained  on  AFTO  form  781  series  Is  transcrllK'd 
onto  prepunched  Air  Force  form  259  cards  for  subsequent  processing. 

d.  Prepunched  Air  Force  form  259,  used  In  conjunction 
with  AFTO  form  781,  contains  the  serial  number,  PDS,  organization  number, 
kind  and  type,  command  code,  CONliS/overseas,  status,  and  work  assignment 
status  codes. 

e.  Air  Force  Form  2145,  ".lob  Control  Docviment",  is 
the  primary  source  document  for  CFM  status/inventory  reporting. 

2.  Data  Sources;  - In  addition  to  the  raw  data  obtained  from 
the  data  collection  forms  discussed  in  the  preceding  paragraphs,  the  Aerospace 
Vehicle  Inventory  Status  and  Utilization  Reporting  System  uses  input  from  the 
Maintenance  Cost  System  (MCSj  in  producing  the  RCS;LGY(D)7140  reports. 

*Note:  AF  Forms  259  and  359a  will  become  obsolete  when  Increment  2 of  MMlCS 
is  implemented.  Data  will  be  input  directly  via  remote  terminals, 
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Those  reports  (output  products)  contain  Inventory,  status,  and  utilization  data 
i'or  the  aircraft  possessotl  each  day,  and  also  contain  the  inonth-to-date  totals. 

(d)  Automatic  Data  Systems  Associated  with  the  Aerospace 
Vehicle  and  Kqulpment  Inventory,  StaUis,  and  Utllly-atlon  Iteportlnn  System 
(AFR  65-110). 

1.  GOIiaA/AW,  ’’Aerospace  Vehicle  Status  Ueportlnt* 
System.”  This  sysFem  Is  used  for  reporting  Inventory,  status,  and  utlll/ation  of 
aerospace  vehicles  to  possesslnt;  organizations,  Major  Commands,  and  AFLC. 
AKM  f)r>-2fi0  and  AFM  171-200,  Volumes  I and  11,  describe  the  system  operation 
and  out^mt  products. 

2.  G03;U'i/R1,  "Ti'alner  Kqulpment,  Inventory,  IHllization, 
and  Status  Reporting  System."  This  system  is  used  for  reporting  Inventory, 
status,  and  utilization  of  selected  tralners/ti'alnlng  equipment  to  possessing 
organizations,  and  AFLC.  AFM  05-272  and  AFM  171-272,  Volumes  I and  11, 
describe  the  system  operation  and  output  products. 

d.  GOddE,  "Communications  - Klectronlcs  - Meteondogical 
(CEM)  Equipment  sFatus  and  Inventory  Reporting  System."  This  system  Is  used 
for  reporting  status  and  Inventory  of  CEM  equipment.  AFM  05-205  describes  the 
i system  operation  and  out^mt  products. 

i 

: (e)  Output  Pi’oducts  anti  Reports  of  the  ADSs  Assoclat>*d  with  the 

I Aerospace  V'ehicle  and  Equipment  Inventory,  Status,  and  Utilization  Reporting 

I System  (AFR  05-110). 

I 

Table  4-5f  lists  the  output  products  from  the  three  .ADSs 
associated  with  AFR  05-110.  This  table  lists  the  FCN.  title  of  product,  and 
the  page /paragraph  of  the  AFM  where  a description  of  the  report  can  be  found. 
Appendix 4-5C  contains  reproductions  of  the  specific  chapters  of  AFMs  05-200, 
05-205,  and  05-272  which  provide  complete  descriptions  of  the  output  products, 
samples  of  the  reports,  and  discussions  of  the  equatlons/algorlthms  used  In  the 
computer  programs. 

I 

(4)  Product  Ferformance  System  (1X>50). 

(a)  Objective  - The  objective  of  the  1X150  Product  Performance 
System  Is  to  accumulate  and  display  all  available  failure  Information  on  specific 
end  items,  by  weapon  systems  and  components. 

(b)  Policy  and  Procedural  Documentation  for  1X150. 

U AFLCM  171-45,  Product  Performance  System  (11050] 
AFLCM  171-45  defines  the  procedures  necessary  for  the  operation  of  the 
Product  Performance  System. 

2.  AFLCR  00-15.  Product  Performance.  AFLCR  00-15 
contains  policies,  requirements  for  data  system  maintenance,  and  procetlures 
governing  the  utilization  and  analysis  of  deficiency  data  reported  on  Air  V'orce 
systems  and  equipment. 
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TAP1,K  4-r)f,  OUTIHIT  PUODUCTvS  OF  AFUOSPAC'F  VFH1CT,K  INVFNTOKY. 
STATUS,  ANH  UTILIZATION  IIF POHTINC  SYSTFM  (AFU  (in-llO)  (Sheet  1 of  3) 


Product 

Control 

Number 

Title 

Itef. 

Document 

Pa  Re/ 
ParaRraph 

A.  C.033A  OUTPUT  PltODUCTS 

N2fi0001 

N2fi0002 

Aerospace  Vehicle  Audlt/Frror 
Inventory  Mst 

AFM 

03-200 

3- 1/3 -2 

N2()000fi 

Aircraft  Iteported  to  AFLC  and 
MAJCOM  Iteport 

3 -3/3 -3 

N2r.0007 

Aerospace  X’ehicle  Status  Iteport 

3-3/3- 4 

N2r.0008 

Aerospace  V’ehlcle  Status  IMs- 
trlbutlon  Iteport 

3 -3/3 -3 

N2r.0009 

Aerospace  Vehlele  VVUC  Iteport 

3 -3/3-0 

N2fi0010 

Aerospace  Vehicle  Flylnfi  Iteport 

3-3/3-7 

N2f.0011 

Aerospace  Vehicle  MCS  Summary 
Iteport 

3 -3/3- 8 

GC.B070A 

80/so  Fist  of  Duplicate  Transactions 

3 -3/3 -9a 

GGB7F04 

Aerospace  Vehicle  Status  Iteport  by 
MDS 

3-3/3-9b 

GGmFOB 

Aerospace  N’ehicle  Status  Iteport  by 
Sub-Command/Numbered  Air  Force 

3-3  3-9e 

GGBDFOA 

Top  10  Unscheduled  Items  NOIt 

3-3/3-<)d 

GGBOFOB 

Top  23  Unscheduled  Items  NOIt 

3-3  ''3-9e 

G0J3F0A 

Monthly  Summary  of  Unschedided 
Items  Non 

3-3/3-9f 

GGJFOB 

Aerospace  Inventory  by  MDS 

3-0/3-9R 

GGXIFOA 

Inventory  Chanttes  and  Frrors 

3-0/3-9h 

GGX2F0A 

Inventory  by  Assigned  OrKanl/.ation 

3-0/3-91 

GC.X3F0A 

Work  Unit  r(ule  ChanRe  Fist 

3-0/3-91 

GGX3FnB 

Work  Unit  Code  Master  Fist 

3-0/3-9k 

GGBFOA 

Aiullt  'F  rror  1 1st 

AFM  03-200 

3-0/3-91 

4-l9r, 


a 


rroiluot 

Control 

NumtHU' 


l AUCK  4-5f.  (Shoot  2 of  3) 


Uof. 

Dooiimoiit 


Title 

A. 


(Conti 


I’liKo/ 

I'araniuph 


ooni'oii 

Inventory  Channe  List 

A KM  ( 

L'l-LV-.O 

:!-7/3-‘.lni 

OC.HllKOC 

Non- Professed  Krror  List 

:i-7  '3-‘»n 

(lOJTKOA 

A Ire  raft  Inventory 

:i-7/:i-i>o 

UCJllFOA 

Aerospace  X’ehlcle  KlylnR  lleport 

A KM  fir>-2T.O 

:i-7/3-S)p 

n,  C033K  OUTPUT  PllOOUCTS 


22014A 

CKM  Kdlt  List  (for  14203  Computer 
l^nlyl 

A KM  ( 

115-205 

3-1  ^3 -2a 

N 2 0500 2 

Ually  CKM  l>etntl  Card  List 

3-1  '3-2b(ll 

N2(5r>007 

Pally  Petall  Status  (Open  Incidents 
t^nlyl 

3-1/3 -2b  (2) 

N2or>oos 

CKM  Master  Inventory  by 
(4rnnnl/.ntlon 

! 

3-1  ^3-2b(3l 

♦11800/200 

iir.ooo 

♦Note;  IIOOOO  products  are  the  same 
as  11800/200  con^mter  products  ex- 
cept for  PCN  number.  Roth  PCN 
numbers  are  sh('wn  as  11800/200/ 
IIOOOO. 

23101A 

c.(:a2koa 

80/80  List  of  PupUcate  Transactions 

3-2'3-2c(ll 

23 10  5 A 
(;C,A4K0A 

Pally  CKM  Petall  Card  Kdlt 

3-2''3-2c(2l 

23110A 

C.tlAfiKOA 

Pally  Petall  Status  (Open 

Incidents  Only) 

3-2/3-2e(3l 

23  USA 
GOUKOA 

Command  CKM  Kqutpment  Status 
Report  (HCS:  IIAK-LC.Y  (M>  7152) 

1 

3-2'3-2e(4l 

2312SA 

GGISKOCA 

Monthly  WUC  Summary 

i 

3-2/3- 2c(5) 

23130A 

C.(;17K0KA 

Monthly  CKM  Petalled  KSU  Llstlnfi 
by  TMS 

A KM 

05-205 

3-2  '3- 2c  (tp 

TAni.K  l-5f.  (Sheet  3 of  3) 


Uioduct 

Control 

Number 

Title 

Itef. 

Doeument 

Page/ 

Paragraph 

B.  (Cont) 

— 

23133A 

GC.19F0EA 

231  tOA 
GGfAFODA 

23145A 

GGICFOEA 

2314flA 
GGIE  FOCA 

23 150 A 
GGIKFOCA 

23165A 

GGTIFOBA 

UeSrHAF- 

LGY(M17152 


Monthly  CEM  Oetnllecl  ESlt  I.istinjt 
by  Organization 

Monthly  CEM  Master  Inventory  by 
TMS 

Monthly  CEM  Master  Inventory  by 
Organization 

TMS  Totals  by  Sub-Command 

Monthly  VVl'C  Summary  — Supply 
Delays 

End  Item  Summary  by  TMS 
A FTC  Summary  Tape 


AFM  05-255 


AFM  (>5-2(>5 


3-3/3-2c(7) 
3-3/3-2e(S) 
3-3/3-2c(lb 

.S’-3/3-2e(I0) 

3-3/3-2e(ll) 

3-3/3-2e(12) 

3-3/3-2c-(13l 


C.  G033G  OUTPUT  UHODUCTS 


272001 

B-3500  Trainer  Equipment  Edit 

AFM  05-272 

3-1 /3-2 

Listing 

N272003 

B-3500  Monthly  Base  Level 

Trainer  Status  Summary  Ueport 

3-2/3-3 

N272002 

B-3500  Replenishment  Cards 

3-2/3-4 

N272004 

B-3500  Error  Cards 

3-3  '3-5 

22401A 

B-203  Trainer  Equipment  Edit 
Listing 

3-3 /3-0 

22403A 

B-2fi3  Monthly  Base  Level  Trainer 

AFM  05-272 

3-3  '3-7 

Status  Summary  Report 
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(0)  Data  Sourcos  for  l)()r>(). 


Maiati'naiiro  Data  Colloctlt'a  System  (CUHUD^  provides  the 
AKM  (>0-1  maintenaaee  liata  neaerated  by  the  bases.  'I’he  data  is  transmitted  to 
AKI.C  from  throughout  the  world  by  AUTDDIN,  and  by  mail  in  the  form  of  mag- 
netic tape  and  punelu'd  eani  decks  bearing  report  control  symlk>l  (UCS) 
LOti-MMO-(Alt)71-t2.  (lOOlD  is  discussed  in  para.  t-Obfl). 

2.  Aerospace  Vi'hlele  Inventory  and  Inventory  Changi> 
Heportlng  (CIOOO)  proviiies  air  vehicle  operating  data  by  hours  flown,  landings, 
sorties,  ami  inventory.  I'lOOO  is  discussed  in  para.  4-r>b(.‘h. 

n.  Master  Item  Identification  Control  System  (MllCSl, 
fix')  Id),  provides  an  invt'ntory  data  base  of  Air  Force  supiily  items  by  stock  and 
part  number  which  is  used  to  identify  and  verify  AFM  00-1  transactions. 

4^.  Master  Cri>ss  lleferenee  File  — Stock  Control  Data 
(D14dB)  provides  eqidpment  specialist  and  division  manager  codes  for  the 
IXIOOC  C4  master. 

tether  relateil  harii  copy  is  input  in  the  form  of  punched 
cards,  annotated  DOOO  reports,  and  AF  form  lOdO  which  provides  master  file 
update  Information  and  system  report  requests. 

(d)  Automated  Data  Processing  Systems  of  IXhOO  - The  lX’>r>0 
Product  Performance  System  consists  of  five  processing  segments  (subsystems), 
as  follows: 

1.  IX^nr.A,  "Kdit  and  Error  Analysis."  The  DCtfxlA  sub- 
system is  the  point  of  input  for  the  bulk  of  the  transactituis  processed.  .All  of 
the  AFM  ttfi-l  data  (UCS:L(1(i-MM(l(AU)71 42)  receive  a comprehensive  edit  in 
accordance  with  the  procedures  outlined  in  Technical  Order  00-20-2-11. 
Transactions  that  do  not  pass  the  edit  are  counted  and  displayed  on  reports  which 
arc  returned.to  the  initiator  for  eorrection  and  resubmission.  These  reports 
Include  IlCS:LOG-MMO(M)71T>2,  "Error  Analysis  Summary",  and  l,OC-MMO 
(AH)7ir>3,  "Error  Detail  Fisting".  Transaetlons  that  pass  the  eilit  are  separated 
into  subject  matter  grovips,  and  routed  into  the  other  subsystems  of  lX>r>(>  or  to 
other  interfacing  data  systems. 

2.  1X43014,  "On  Equipment  Analysis.  " The  1X43014  sub- 
system receives  AEM  00-1  data  (UCS:l,Ori-MMO(AU)7l42)  that  are  related  to 
the  end  piece  of  equipment  by  WUC  and  have  been  ldet\tified  as  v>n-equipment 
records  by  IX430A.  In  addition,  datji  are  received  from  Aircraft  Incident^ 
Emergency  Unsatisfactory  Keport,  and  from  the  .AEll  03-110  (0(4:43)  system. 

The  resulting  reports  provide  a variety  of  management  deelsion-making  aids. 

The  on-equipment  data  are  maintained  on  1X43014  files  for  12  calendar  months 
from  date  of  receipt. 

3.  1X430C,  "Off-Eaulpment  Analysis.  " The  1X430('  sub- 
system receives  AEM  00-1  data  (UCS:  l,(40-MM(4(Alt)7142)  that  has  been 
identified  as  off-equipnu'nt  records  by  IX430A.  In  addition,  it  processes  the 


4-199 


Master  Item  Ideatlfleation  Control  System  file  to  pick  up  assoelated  data. 
Processing  within  this  sulisystem  is  usually  by  federal  stock  class  and  item 
part  number.  Within  DCStlC,  two  processing  se>jments  may  be  accomplished 
independently:  NUTS  ami  I’MK  reports. 

4^.  lXh')()K,  ".AFM  ('>('>-!  Maintenance  Ihita  to  Contractor." 

The  IX45fiK  subsystem  processes  the  on-epulpment  and  off-equipment  tapes 
from  IX'iSdA,  anti  segregates  proiluct  information  for  authorized  contractt)rs. 
The  out|)ut,  in  tape  form,  is  maih'd  monthly  to  the  Interested  contractor,  pro- 
viding a direct  Interface  between  IHind  and  the  ilata  system  operated  or  sub- 
scribed to  by  the  contraett'f.  In  aildltion,  the  following  are  forwarded  to  ALCs 
in  support  of  contractual  stuilies; 


iteports. 


a.  Aircraft  Accident  Fmergency  Unsatisfactory 


b.  (h^-Kquipment  Product  Performance  Pi  Master 
th'cord.  A PI  master  record  is  prepared  and  maintained  for  each  end  article  of 
equipment  on  which  M1>C  system  t)n-t'quipment  mainttmance  data  reports  from 
the  IXISOP  subsystems  are  rciiuireil. 


c.  Off-F.quipment  Product  Performance  C l Master 
Ueconls.  C l master  reciuds  on  most  items  are  prepared  automatically  (using 
cataloging  data  from  the  MllCS  file)  w ithin  the  computer  of  AFLC.  C l master 
records  are  prepared  and  maintained  for  each  item  on  which  off-equipment 
maintenance  data  reports  from  the  [H'fSfiC  subsystems  are  required. 

d.  t^n-Fquipment  Pata. 

ji.  IKh^dF,  "Master  Records  and  Demand  Requests  by 
IM/SM."  The  DCfifiF  subsystem  provides  a means  for  the  System  Manager  and 
Item  Manager  to  update  the  1)05(111  and  IXiSfiC  master  files  and  to  request 
DOr>r»P  and  DOr>r>C  products. 

(e)  Table  l-r>g  contains  a list  of  the  outjnit  products  available 
from  the  IXififi  subsystems.  The  table  lists  the  new  report  control  symbr*!, 
title,  and  reference  paragraph  in  .AFI.CR  fifi-15  where  a brief  description  of  the 
report  can  be  found.  Table  l-rdi  contains  a cross  reference  to  the  old  and  new 
UCS  and  the  PCN.  Appendix  l-fiD  provides  detailed  descriptlt>ns  of  the  oubwit 
reports. 


(0  lX~>r)r)  Product  Interfaces. 

The  lX)r>fi  system  provides  data  for  input  into  other  computer 


systems. 

as  follows: 

1. 

D047 

2. 

IX)57G 
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TABLE  4-r)h.  C BOSS- llEFE HENCE  LISTING  OF  RCS  (OLD),  HCS  (NEW),  ANM) 


FCN  (NEW)  FOR  1X156  OUTPUT  PRODUCTS  (Sheet  1 of  2) 


New  PCN 

Old  RCS 

New  RCS 

1X')56A1201 

1-LOG-K260 

LOG-MMO(ARI7160 

DO56A1202 

2-LOG-K260 

LOG-MMO(\V’>7161 

IX156A1203 

3-LOG-K260 

LOG- M MO  (MI  7 162 

DO56A1204 

4-LOC.-K260 

LOG-MMO(ARl7163 

1X156A1205 

5-LOG-K260 

LOG-MMO(MI7164 

Maintenance  Action 

Detail  Cards  from 

AF  Bases 

1-LOG-K97 

Lt)G-MMO(A  R)7142 

IX)56B1501 

PRINTOUT 

1-LOG-K261 

L(X1-MM0(AK)7165 

D056B15A1 

EDIT 

D056B5002 

2-LOG-K261 

HX'.-MMO(AR)7166 

DO56B5503 

3-LOG-K261 

LOG-MMO(AR>7167 

DO56B5504 

4-LOG-K261 

LOG-MMO(AR)716S 

DO56B5505 

5-LOG-K261 

LOt'.-MMt)(ARI7169 

D056B5006 

6-LOG-K261 

LOG  - M MO  (A  R)  7 170 

D056B5007 

7-LOG-K261 

LOG-MMO(AR)717l 

D056B5008 

8-LOG-K261 

LOG-MMO(AR)7172 

D056B5010 

10-LOG-K261 

LOG-MMO(ARI7173 

DO56B5011 

11-LOG-K261 

LOG-MMO(ARl7174 

DO56B5012 

12-LOG-K261 

LOG-MMO(AR)7175 

DO56B5014 

14-LOG-K261 

lAX'.-MMO(A  R17177 

DO56B5015 

15-LOG-K261 

LOG-MMO(MI7178 

DO56B5016 

16-LOG-K261 

LOG-MMO(ARI7179 

DO56B5017 

17-LOG-K261 

U1G-MMO(A  R171S0 

D056B5020 

20-LOG-K261 

LOG-MMO(ARI7305 

D056B6521 

21-LOG-K261 

LOG-MMO(ARI7182 

D056B5522 

22-LOG-K261 

LOG-MMO(ARl71S3 

DO56B5023 

23-LOG-K2f.l 

IXX'.-MMti(ARl7184 

DO56B5025 

25-LOG-K261 

LCX;-MMO(ARl7185 

D056B6526 

26-LOG-K261 

L0G-MM0(M>7186 

n056B5527 

■ 

LOG-MMO(ARI7220 

-2 
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TABLE  4-5h.  (Sheet  2 of  2^ 


New  I’CN 

Old  UOS 

New  UCS 

IX')56C4401 

1-LOG-K262 

L0G-MM0(AB)7187 

IMUNTOUT 

IX156C3401 

EDIT 

nO56C4402 

2-LOG-K262 

I.(Kl-MMO(A»)7188 

nO56C4403 

3-LOO.-K262 

L0G-MM0(AK)7189 

r)O56C4404 

4-LOO.-K262 

1AX'.-MMO(AB)7190 

DO56C6605 

5-LOG-K262 

HX’.-MMO(Am7191 

1X456C4407 

7-LOG-K262 

LOG-MMO(AB)7192 

IX'>56C5009 

9-1.0G-K262 

LOG-MMO(Q)7193 

005605010 

10-l,OG-K262 

LOG-MMO(Q)7194 

D056C4417 

17-LOO.-K262 

1aX'.-MMO(AR>7195 

n056C5718 

18-I.OG-K262 

LOG-MMO(AR)7196 

005605719 

19-LOO-K262 

LOG-MMO(AR)7197 

005605920 

20-1,00. -K262 

IAK'.-MM0(SA)7198 

00560  5021 

21-LOO-K262 

L0G-MMI.M^^)7199 

005605022 

22-LOO.-K262 

LOG-MMO(M)71100 

005605024 

24-I,OG-K262 

LOG-.MAIO(AR)71101 

005603226 

26-l,O0,-K262 

lAXI-MMO(lVfI  71102 

005605027 

27-LOO,-K262 

IAX;-MMO(QI71103 

005605028 

28-LOO.-K262 

1aK'.-MMO(Q>71104 

005605929 

29-I-OG-K262 

LOG-MMO(SA)71105 

005605930 

30-LOG-K262 

LOG-MMO(SA)71106 

005603231 

31-LOG-K262 

LOG'hlMO(hB71107 

005603232 

32-LOG-K262 

LOG-MMO(M>71108 

005605033 

33-LOG-K262 

LOG-MMO(SA>71109 

005603234 

34-LOG-K262 

LOG-MMO(SA>71110 
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IXV2H 


(H1Al,C 


K(iril  at  SMAI.C 


X Comnioiiity  Confiijuration  ManaRomont  Systc'ni,  IXKifi 
A,  Aerospace  Vehicle  Status  ReporliiiK  System,  (’lO.'l.’lA 
f).  Knjvine  ConfiKuratlou  Mananemenl  System  (KCMS), 


n.  Space  anci  Missile  System  Or('ani/.ati<m  (SAMSO) 

7.  Military  Airlift  Command  (MAC) 

S.  Air  K«)rce  Communication  Service  (AFCS) 

CSAF  Security  Service  (USAFSS) 

10,  Tire  Improved  lleliability  Kvaluation  System,  (lOll  at 


11.  Weapon  System  Iteliahility  Matlu'inatieal  Model  l'ro(jram, 


12.  Air  Defense  Command  (ADC) 

12.  I'Mifiht  Safety  Prediction  ’i'echniiiue,  CiOOn 

l->.  Contractor  <lata  in  tape  form  to  approvi'd  eontractoi's  who 
hav<'  reqiU'sted  information  on  tlu'ir  products. 

(fO  Increase  ttelialiility  of  Cperational  Systems  (KCtSl) . 


(a)  Olijectives. 


dlqeetives  of  the  increase  iU'liabiiity  of  Cperalionai  Systems 
(iiUlS)  l’ro)jram  arc  to  irlentify  tlu>se  sul)systcms,  com|)onents,  and  items  of 
e(iulpmcnt  that  arc  disproportionate  consumers  of  resources,  hipih  contributors 
to  system  nonavailability,  or  potential  safety  problems  based  on  their  reliability 
or  maintainability  performance.  lltCS  has  been  desifj^cd  to  quantitatively  assess, 
predict  and  improve  the  effectiveness  of  weapon  or  support  systems  by: 

1.  Measuring  and  tracUinn  the  performance,  relialdilty, 
maintainability,  safety,  and  logistic  support  costs  of  items.*  litCS-tienerated 
cost  data  include  depot  and  field  maintenance  costs  of  the  following  nature: 

a.  Field  and  oixani/.atlonal  maintenance 

b.  Specialized  repair  activity 


♦This  summary  Is  extracted  from  a report  prepared  for  the  Air  Force  Project 
Rand,  titled  An  Appraisal  of  LoKlstles  Support  Costs  Usetl  in  the  Air  Force 
IROS  Program,  Report  R-ir>r,i1-PR,  February  1972. 
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£.  PackaRlnK  and  shipping 

d.  Condemnation  costs 

e.  Base  materiel 

It  does  not,  however,  at  the  present  time.  Include  such  costs  as: 

a.  ACiE  maintenance 

b.  POl. 

c.  TCTOs 

d.  Pipeline  spares 

e.  Technical  training 

f.  Systems  management 
Initial  spares. 

(b)  Policy  and  Procedural  Documentation  for  lUOS. 

IIIOS  Is  Implemented  In  accordance  with  the  following 

regulations: 

a.  AKII  •l00-4r>,  Increase  Uellablllty  of  Opr>ratlonal 
System  (IIIOS)  Program,  18  March  I9(>r>. 

b.  AKLCH  400-1(5,  AKLC  Increase  Heliabillty  of 
OptM'ational  Systems  (IH()S)  Program,  18  January  1974. 

Revisions  to  existing  publications  (e.g. , AFM  (5G-18, 
AFIiCM  171-229)  are  currently  In  process  to  fully  document  the  latest  version 
of  the  IROS  model.  Its  associated  program  oquatlons/algorithms,  and  output 
products.  Until  those  revised  documents  are  available,  personal  contact  with 
AFLC/MMO  personnel  at  Wright  Patterson  Air  Force  Base  will  be  necessary  to 
supplement  the  Information  contained  In  this  document. 

(c)  Data  Sources. 


The 

following  data  systems  provide  Input  to  the  IROS 

Program: 

1. 

1X443  Cataloging  Data 

2. 

GO  33  Aerospace  Vehicle  Inventory  and  Equipment 

Status  Ri'port 

3. 

G098  PDM  Interval  Analysis 
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a 


•1.  IXIfifi  Product  Performance  System 


I 


T).  IX12  II  Knp:lne  Confi(juration  ManaKcment  System 

fi.  Dl-Pt  Mana(j;ement  Division  and  Tectinician  Idmitificatlon 

tUUl  Tire  Improved  Keliabllity  Kvaluation 

('lOSl  l,ockhee(i  Cr)A  MA DA ItS/c; round  I’rocesslnu 
Systems. 

((i>  (Xitr)Ut  IM’oducts. 

Table  l-fd  contains  a listing  of  lllOS  (Kti5D  output  products. 
Appendix  4-blO  contains  the  equatlons/alpiorlthms  ami  samples  id'  the  output 
products. 

(fi)  Selective  Management  of  Propulsion  Units  (Knpiine  Status 
Uept^rtlnK)  1X121. 

(a)  Objectives. 

The  basic  objective  of  the  ent;ine  reporting  system  is  to  pro- 
vide management  with  information  needed  for  allocation  of  funds,  procurements, 
computation  of  overhaul  requirements,  engine  Inventory  and  distribution,  deter- 
mining spare  engine  requirements  and  disposal,  and  preparing  budget  estimates. 
Inteimiedlate  objectives  are  to  maintain  an  accurate  and  timely  engine  inventory, 
reduce  pipeline  time,  exv)edite  transportation,  reduce  overhaul  time,  extend 
field  maintenance  capabilities  and,  in  general,  streamline  engine  management 
techniques. 


(b)  Policy  and  Procedural  Documentation. 

A PM  100-1,  Volumes  I and  11,  Selective  Management  of 
Pi-opulslon  Units,  ;U  October  1008,  provides  the  general  information,  assigned 
responsibilities,  reporting  information  and  instructions  for  Implementing  engine 
•status  reporting  and  processing  the  1X124  outimt  products. 

(c)  Data  Collection  Porms/Pata  Sinirees. 

AP  form  10,14,  "Kngine  Status  Report,"  is  the  source  docu- 
ment used  for  data  collection  and  subsequent  data  input  to  the  1X124  Automatic 
Data  System. 

(d)  (lutput  Products  of  1X124  Data  Collection  System- 

Table  l-.Oj  lists  the  engine  management  products  available 
from  1X124.  Brief  descriptions  of  selected  out^iut  products  follow  table  l-.l). 


I 
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TABLE  4-r>l.  lUOS  OUTPUT  PKODUCTS 


RCS/PCN 

Title 

RCS:  LOG-MM(y)7372 

K051.  YRIL 

System  Effectiveness  Report,  Parts  I and  11 

RCS:  LOG-MMO((i)7213 

K051.PW5L 

Logistic  Support  Cost  Ranking,  Selected  Equipment 
Work  Unit  Codes 

K051.  PNIL 

Logistic  Support  Cost  Ranking,  Selected  Items 

K051.  PN3L 

Logistic  Support  Cost  Ranking,  Work  Unit  Code  Status 

K051.  PN4L 

Logistic  Support  Cost  Breakdown,  Current  Quarter 
Computation 

K051.  PN6L 

liOgistlc  Support  Cost  Ranking,  National  Stock 

Number  Status 

RCS:  LOG-MMO(Q)7215 

K051.  PN7L 

Maintenance  Action  Summary 

K051.PN8L 

Logistic  Support  Cost  File  Maintenance  Register 

RCS:  LOC.-MMO(Q)7213 

K051.  PW2L 

Logistic  Support  Cost  Ranking,  Item  Manager 

National  Stock  Number  Status 

K051.PW3L 

Logistic  Support  Cost  Ranking  High  Burner  Work  Unit 
Codes 

K051.PW4L 

Logistic  Support  Cost  Ranking,  Weapon  System 
Correction 

K051.  PZIL 

Logistic  Support  Cost  Ranking,  Ground  CEM 

Equipment 

RCS:  LOG-MMO(Q)72ir> 

K051.  YNIL 

System  Availability  Model,  Selected  Equipment  Work 
Unit  Codes 

K051.  YN3M 

System  Availability  Model,  Work  Unit  Code  Status 

K051,  YN4M 

System  Availability  Model,  Work  Unit  Code 

Computation  Data 

K051.  YN5M 

System  Availability  Model,  Aircraft  Status 

K051.  YN6M 

System  Availability  Model,  Aircraft  Computation  Data 

RCS:  LC)G-MM(Q)7372 

K051.  YRIL 

System  Effectiveness  Report 
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Appendix  4-5F  contains  further  amplification  of  the  selected  products  and 
samples  of  the  reports.  A complete  set  of  all  products  can  be  obtained  from; 

Propulsion  System  Section  (ACDTP) 

Technical  Systems  Branch 
Data  Automation  Division 
Comptroller 

Oklahoma  City  Air  Logistics  Center 
Tinker  Air  Force  Base,  Oklahoma 

(e)  Selected  D024  Output  Product  Descriptions. 

1.  D024AEH1A,  "Propulsion  Unit  Operating  Time  and 
Iteconciliation  Report",  Part  I and  Part  n,  "Quarterly  Operating  Time  Listing", 
is  used  for  obtaining  operating  time  reports  for  actuarial  purposes  and  recon- 
ciliation of  base  engine  assets. 

2.  D024BBE1W,  "ENORS  Uninstalled  Engine  Status  Report 
Summary  by  Comma^nd",  provides  data  for  surveillance  and  control  of  conditions 
where  maintenance  work  stoppage  resulted  from  nonavailability  of  parts. 

3.  D024BBE2W,  "ENORS  Command  History, " is  the  same 
as  D024BBE1W  above,  except  this  product  is  summarized  by  command. 

4.  D024BBJ1W,  "ENORS  Uninstalled  Engine  Status  Report", 
provides  data  for  surveillance  and  control  of  conditions  where  maintenance  and 
work  stoppage  resulted  from  lack  of  engine  spare  parts.  The  report  shows  data 
for  possessor  and  family  group. 

5.  D024BBN1W,  "ENORS  Uninstalled  Engine  Status  Report, 
Type",  is  the  same~as  D024BBJ1W  except  summarized  by  engine  type. 

6.  D024BBRIW,  "ENORS  Uninstalled  Engine  Stiitus  Report 
Summary  by  Serial  Number",  is  the  same  as  D024BBE1W  except  summarized  by 
engine  serial  number. 


7.  D024BCD1M,  "Propulsion  Unit  Repairable  Report", 
reflects  the  f-  ^.-ory  of  each  engine  from  the  time  it  is  reported  repairable  until 
it  is  reported  serviceable  or  installed. 

8.  D024BGU1M,  "Propulsion  Unit  Foreign  Object  Damage 
Report",  provides  data  to  evaluate  the  rate  and  extent  of  engine  removals 
resulting  from  foreign  object  damage.  It  also  lists  major  overhaul  by  type  of 
aircraft. 
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9.  IX')24BJG2M,  "Propulsion  Unit  Roportinjj  System 
Overhaul  and  Base  Maintenance  Completions",  provides  data  used  by  engine 
item  managers  to  determine  the  number  of  engines  that  have  ccmipleted  an  over- 
haul or  a base  maintenance  cycle  during  the  reporting  period.  The  data  are 
used  to  compute  future  workload  factors. 

10.  1X)24CDC3\V,  "Spare  Engine  Report",  indicates  the 
status  of  spare  engine  assets  for  each  base.  The  report  is  a tool  for  command 
headquarters  in  monitoring  the  spare  engine  support  position  at  each  subordinate 
activity,  and  the  effectiveness  of  resvipply  action. 

11.  IX')2  tCHSlM,  "OCAT.C  Propulsion  Unit  Resupply  Time 
Report",  provides  a method  for  measuring  engine  resupply  time.  Resupply  time 
is  the  number  of  days  between  the  date  an  engine  is  determined  as  requiring 
depot  level  (majorl  overhaul,  and  the  date  a serviceable  replacement  is 
received. 

12.  D021DAE1Q,  "Propulsion  Unit  Pipeline  Time  Analysis, 
Part  I - By  Famil}^  Command,  and  Station",  presents  an  analysis  of  desirable 
pipeline  segment  data  for  each  family  of  engines,  stations,  and  commands. 

13.  D0241')AEIQ,  "Propulsion  Unit  Pipidine  Time  Analysis, 
Part  n - By  Command,  Station,  and  Family",  presents  an  analysis  of  undesir- 
able pipeline  segment  data  for  each  family  of  engines,  stations,  and  commands. 

14.  D024DAQIQ,  "Propulsion  Unit  Pipeline  Time  Analysis, 
Part  lA  - by  ALC,  Family",  provides  an  analysis  of  desirable  pipeline  segment 
data  for  each  family  of  engines  at  each  command. 

If).  D024F1021,  "Installed  Aircraft  Engine  Report",  contains 
data  on  installed  aircraft  engines,  i.e. , number,  total,  average  operating 
hours,  and  average  age.  Data  are  summarized  by  command  and  engine-aircraft 
combinations.  This  report  is  the  sole  source  of  engine  flying  hours  by  reported 
engine-aircraft  designation  and  command.  Data  are  used  by  engine  actuaries 
and  for  special  studies. 

Ifi.  D024FI022,  "OFR  Technical  DaLa  Record",  shows  data 
from  the  master  files,  including  official  failure  rates  and  other  data  used  to  pro- 
duce exposure  and  failure  rate  products. 

17.  IX')24EI023,  "Aircraft  Engine  Exposure  Product”,  tabu- 
lates exposures  and  removals,  compares  official  failure  rates  of  failures 
experienced  during  the  quarter,  and  provides  a summarv  of  operating  hours, 
removals,  experience  factors,  and  engine  inventory  distribution  by  age.  These 
data  serve  as  input  to  failure  rate  products,  forecast  products,  quarterly  engine 
status  table,  and  special  studies. 

18.  IX424EI031,  "Aircraft  Engine  Removal  and  Loss  Report", 
shows  data  on  all  engines  lost  from  the  inventory  or  removed  from  an  installed 
status  during  the  quarter,  and  provides  indi  i ually  the  reasons  for  failure. 
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removal  or  engine  loss.  The  data  are  used  in  reliability  analyses,  quality 
control  studies,  and  special  studies  concerning  reasons  for  removal. 

19.  IX)24FN021,  "Aircraft  Engine  Exposure  Product", 
presents,  by  command,  tabulations  of  exposures  and  removals;  comparisons  of 
official  failure  rates  to  rates  of  failures  experienced  during  the  quarter;  a 
summary  of  operating  hours,  removals,  and  experience  factors;  and  a listing  of 
engine  Inventory  distribution  by  age.  The  report  provides  Inputs  to  command 
failure  rate  products,  forecast  products,  and  special  studies. 

20.  D024FN022,  "Aircraft  Engine  Combined  Failure  Rate 
Product",  provides  actuarial  data  by  command  for  analyzing  the  effects  of  field 
maintenance  on  overhaul  engine  life,  and  to  study  actuarial  engine  life  on  total 
failures.  This  report  is  used  to  compute  failure  rates  on  total  failures  for 
maintenance;  to  calculate  current  dependability  indices;  to  analyze,  smooth,  and 
project  crude  failure  rates;  and  to  test  statistically  both  official  and  smooth 
failure  rates;  all  by  command. 

21.  D024FN023,  "Aircraft  Engine  Experience  Analysis 
Product",  lists  operating  hours  and  failures  by  base,  command,  mission,  over- 
haul agency,  engine  aircraft  combination,  and  number  of  previous  field  repairs; 
and  provides  data  for  approximating  engine  life  by  subgroup  and  provides  hours 
flown  per  failure.  The  report  is  used  to  analyze  usage  experience  data  accord- 
ing to  engine  source,  command,  model,  and  mission;  and  to  determine  which 
subgroups  have  abnormal  experience. 

22.  D024FR011,  "Aircraft  Engine  Overhaul  Failure  Rate 
Product",  shows  actuarial  failure  rates  for  major  overhaul  from  exposure 
information  grouped  for  several  quarters,  and  is  the  source  of  new  official  over- 
haul failure  rates.  It  is  vital  because  it  provides  input  to  forecast  products  and 
special  studies;  statistically  analyzes,  smooths  and  projects  the  crude  failure 
rates;  computes  actuarial  engine  life,  actuarial  life  remaining  figures,  and 
actuarial  removal  Intervals;  and  statistically  tests  both  official  and  smooth  fail- 
ure rates  on  a world-wide  basis. 

23.  D024FR021,  "Aircraft  Engine  Field  Maintenance  Failure 
Rate  Product",  provides  statistical  analyses  and  projections  of  crude  failure 
rates;  field  maintenance  removal  intervals  and  combined  remov^al  Intervals;  and 
both  official  and  smooth  failure  rates. 

24.  D024FR031,  "Aircraft  Engine  Combined  Failure  Rate 
Product",  provides  official  combined  failure  rates  and  total  failures  for  mainte- 
nance; current  dependability  Indices;  and  statistical  analyses  and  projections  of 
crude  and  smooth  failure  rates.  This  product  provides  actuarial  data  for 
analyzing  the  effects  of  field  maintenance  on  overhaul  engine  life,  and  Inputs  to 
experience  analyses  and  forecast  products. 

25.  D024FR041,  "Aircraft  Engine  Overhaul  Failure  Rate 
Product",  provides  actuarial  failure  rates  by  command  for  major  overhaul, 
from  exposure  information  collected  for  several  quarters;  and  is  the  source  of 
official  command  overhaul  failure  rates.  It  provides  Inputs  to  command 
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forecast  products,  aircraft  engine  experience  analysis  products,  and  special 
studies.  It  is  used  for  statistical  analyses  and  projections  of  crude  failure 
rates,  computer  actuarial  ensine  life,  actuarial  life  remaining,  and  actuarial 
removal  intervals;  and  for  statistically  testing  both  official  and  smooth  failure 
rates. 


26.  1X124FU051,  "Aircraft  Engine  Field  Maintenance  Fail- 
ure Rate  I’roduct",  provides  inputs  to  forecast  products,  quarterly  status  table, 
and  for  special  studies.  It  contains  statistical  analyses  and  projections  of  crude 
failure  rates,  field  maintenance  removal  intervals  and  combined  removal  inter- 
vals, and  both  official  and  smooth  failure  rates  by  command. 

27.  IX)24FY011,  "Aircraft  Engine  Experience  Analysis 
Product",  lists  engine  operating  hours  and  hours  flown  per  failure  by  base,  and 
presents  data  for  computation  of  actuarial  failure  rates  and  approximate  engine 
life  by  subgroup.  The  report  is  used  for  statistical  analysis  of  usage  experience 
data  according  to  base  of  operations  and  to  determine  which  subgroups  have 
abnormal  experience. 


28.  D024KP031,  "Forecasted  Aircraft  Engine  Removals  by 

Quarter,  Worldwide",  presents  forecasts  of  engine  removals  for  major  over- 
haul and  field  maintenance  and  both  combined,  including  forecasts  of  maximum 
time  removals  with  peacetime  programs.  The  report  is  used  to: 


personnel 


a.  Determine  overhaul  schedule  requirements 

b.  Schedule  deliveries  of  new  engines 

c.  Determine  spare  parts  and  workload 

d.  Determine  field  maintenance  requirements 

c.  Assist  in  planning  for  facilities,  equipment,  and 

f.  Compute  spare  engine  requirements. 


29.  D024KP041,  "Forecasted  Aircraft  Engine  Removals  by 
Quarter,  by  Command",  is  the  same  as  D024KP031  (item  ^ above),  except 
that  it  is  limited  to  commands. 

30.  D024KP061,  "Official  USAF  Actuarial  Removal  Interval 
and  Engine  Life  Expectancy  Tables",  provides  a three-part  listing:  W/W 
actuarial  removal  inverval  tables  (Part  I),  engine  life  expectancy  tables  (Part  III, 
and  percentages  and  ratios  of  auxiliary  power  units  and  ground  gas  turbine  engine 
applicable  to  appropriate  aircraft  (Part  Tllj. 
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(7^  Stan(Uiril  Hast'  Supply  SystiMii  (SnSS)  Uionn-li. 

(a^  (M)joc’tl  VOS. 

1.  rho  oblootives  of  tho  Staadani  Haso  Supply  Systoni  with 
rospoot  to  tho  lop;istios  support  of  Air  Koroo  woapon  systoms  is  to  proviso 
motluuls  for  tiiuoly  rosponso  to  usor  noods  for  inatoriol,  and  for  firm  ooulral 
manaKomont  of  l)aso-lovol  iiivoatory  control.  Tho  SRSS  is  dosifjnod  to  onhanoo 
tho  sin)plior/usor  rolalit'ushlp  through  tho  ornani/atlonal  intorfaoo  hotwoon 
maintonanoo  oontrol  ami  supply.  I’ho  ornani/ntional  oomponont  of  mainti'iianoo 
control  that  diroolly  inlorfao(>s  with  Supply  Is  material  control,  which  may  con- 
sist of  four  functions;  mainti'iianoo  supply  liaison,  roparahlo  prooossinp;, 
mohility  support,  and  ornani/ational  supply  support.* 

2.  Tho  Sli.SS  utlll'/.os  tho  t'nivac  10r>0-ll  computer,  which  is 
pronrammod  to  nonorato  output  reports  necessary  for  offoctlvo  maintenance  man- 
airomont.  Several  of  those  reports  are  of  value  during  operational  test  and 

evaluati<m  to  assist  ir  the  assessment  of  mainlenance  repair  eai)ahility  and  ^ 

supply  issue  effectiveness.  1 

(hi  I’oliey  ami  I’rocedural  Documentation. 

Policy  and  procedural  documents  appllcahle  to  the  SliUS  are 

listed  Ih'Iow. 

AVM  PSAK  Supply  Manual;  Volume  1,  Part  2, 

PSAK  Standard  Base  Supply  System. 

2.  AFM  (?(>-!,  Maintenance  Manage tnent;  Volumes  1 Ihroufjh 
XII,  Materiel  Control  st'ctions. 

2.  T(^  00-20-.'],  Maintenance  Pnieessin)^  of  Iteparahle 

ProiH'rty  and  the  Ih'pair  Cycle  Asset  Control  System. 

(c)  Pata  Forms  and  Inputs. 

1^.  AFTC  form  .‘l.'iO,  Reparahle  Hem  Pi-oeessln^  Ta};. 

The  dato  Interface  between  maintenance  and  supply  is  via 
A F IX'  form  .'l.'iO,  "Iteparahle  Item  ProeessiiiK  'Pap;. " When  a demand  is  made 
from  supply  for  a replacement  Item,  a supply  document  luimher  is  obtained 
from  supply  and  reconU'd  on  AFTO  form  220.  Supply  personnel  record  pertinent 
Information  on  AF  form  200.2,  "Is.sue/Turn-ln  Iteqviest",  hearin^;  the  supply 
document  mimlH'r.  This  form  eorreinte.s  supply  transactions  with  maintenance 
actions. 


*Foi'  <’ompIele  descripl ion.s  of  the  re.sponslhillt  ,es  of  Materiel  Ci'ntrol,  refer  ti' 
thi'  appllcahle  sections  of  AFM  Ofl-1,  Volumes  11  throvinh  XII. 
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2.  AF  Form  109H,  lOnO-Il  niiso  Supply  System  rard. 

rhi'  SUSS  IJnivao  10r>0-ll  I'ompiiliM'  is  pronramnuMi  to 
upilati'  c'unvnt  ropair  cyi'li'  itoni  location  and  status  on  an  individual  item  basis. 
Kach  time  a roiiarablo  chanRVs  location  or  status,  an  AF  lonu  I'.Mts  is  filled  out 
and  this  infonuatit>n  is  input  to  the  lObO-ll  computer. 

(eh  (Hitput  Froiiucts  of  the  SltSS  Unlvac  lOriO-ll. 

AFM  (i7-l,  \’olumc  L\  Fart  2,  lists  base-level  i»utput  ri'ports 
available  from  the  SRSS  F10r>0-ll  computer.  The  following;  paraf;raphs  ilescrlbe 
the  products  of  interest  durim;  test  anil  evaluation.  Appendix  1-5(1  contains 
samples  of  selected  SHSS  oulpul  ri'ports. 

1.  1)1  FM  Listing  (H2r)). 

The  l)ue-ln-From-Maintcnance  (DIFM)  l.islinn  is  pro- 
duced by  the  1050-11  computer  from  internally  stored  supply  records  to  aid 
maintenance  activities  in  cent  rolling  reparable  processing,  and  DIFM  assets. 

The  DIFM  Idstiii);  is  available  in  three  format  options:  DIFM  Idstint;,  DIFM 
Fxception  Fisting,  and  DIFM  Stock  Number  Fisting.  These  management  product 
provide  a current  inventory  of  DIFM  items,  including  location  and  status. 

2.  ttepair  Cycle  Data  Fisting  (M02  I1. 

The  Itepair  Cycle  Data  Fisting  complements  the  DIFM 
Fisting  (R20)  for  scheduling  of  repair  cycle  assets,  determining  base  repair 
capability  and  DIFM  control.  It  is  also  used  to  determine  the  number  of  units 
repaired,  categorized  as  NUTS  (not  repairable  this  station),  and  condemned  for 
the  past  year,  and  Identifies  current  quarter  turn-ins  by  aetion  taken  code. 
Fotential  jiroblem  areas  may  be  indicated  by  identitiable  trends. 

5.  Organizational  Kffccti veness  Report  (M2b  reHects  the 
supply  issue  effectiveness  for  the  month  as  a percentage  of  fill  rate.  It  ineludes 
the  effecti veness  of  supply  points,  bench  stocks,  and  other  issues  and  due-outs. 
Supijort  problems  may  be  indicated  by  the  pei-centage  of  support  provided  in 
each  area. 


d.  NORS  Start/Stop  Report,  HAF-F0S(AR1  Tlld  (D2;i/S5t>. 
This  report  provides  an  NORS  summary  within  system  designator  of  total  cause 
code  and  delete  code. 

(H)  Rase  Fevel  Inquiry  Systcu)  (RFIS),  F107A/RF 

(a)  Objective:  The  objccllve  of  the  Rase  Fevel  Inquiry  System 
(F107A/R1)  is  to  provide  users  of  R3500  Automated  Management  Supporting  Data 
Systems  with  an  effective,  simple-to-uso  system  for  extracting  management 
information  from  data  l>ase  files. 


(b)  Output  Product:  The  output  products  available  are  limited 
only  by  the  data  In  the  files,  the  ImaRlnatlon  of  the  analyst,  and  machine  time 
ayallable.  Data  and  expressions  available  are  the  same  as  those  listed  In  the 
discussion  of  the  Maintenance  Data  Collection  System,  subsection  4-5b(l).  Most 
maintenance  analysis  technicians  (AFSC  390X0)  have  the  training  to  retrieve  data. 

^c)  Documentation;  AFM  171-114,  Base  Level  Inquiry  System 
(BLIS),  P107A/R1,  provides  the  general  system  Information,  specification,  and 
resource  requirements.  AFM  171-114  Is  contained  In  three  volumes,  with 
Volume  III  providing  system  user  restrictions, 

(9)  Machine  Independent  System  Effectiveness  Data  System  (MISEDS). 

(a)  Objectives  - The  Machine  Independent  System  Effectiveness 
Data  System  (MISEDS)  provides  a set  of  computer  programs  to  reduce  and 
analyze  a comprehensive  set  of  reliability  and  maintainability  Input  data  products. 
Four  processing  programs  perform  the  function  of  creating  historical  files  of 
reliability  and  maintainability  data  products  to  be  Input  Into  other  programs  for 
analysis.  Quantitative  reliability  programs  provide  nonparametrlc  statistics  as 

a measure  of  subsystem  reliability.  These  programs  provide  man-hours  per 
maintenance  task,  maintenance  man-hours  per  flying  hour,  AGE  utilization,  and 
man-hour  data  to  verify  maintenance  personnel  requirements. 

(b)  Policy  and  Procedural  Documentation  for  MISEDS. 

1.  Maintenance  Technical  Directive  69-1,  Air  Force  System 
Command,  Systems  Effectiveness  Data  System,  AFSC  Form  258/258-4,  Mainte- 
nance Data  Recording  Procedures. 

2.  Machine  Independent  System  Effectiveness  Data  System 
(MISEDS)  Documentation,  Air  Force  Flight  Test  Center,  Edwards  AFB. 

(c)  Data  Collection  Forms/Data  Sources  for  MISEDS  — All 
reliability  and  maintainability  data  products  from  MISEDS  are  obtained  from  the 
data  recorded  on  the  AFFTC  form  300,  AFSC  form  258/258-4,  and  AFTO  form  4. 
Computer  programs  within  MISEDS  perform  basic  calculations,  combine  and 
reformat  the  data  Items,  and  structure  logical  records  Into  reliability  and 
maintainability  history  files. 

1^.  AFFTC  Form  300,  "Aircraft  Debriefing  Record",  Is  used 
for  recording  reliability  data  for  all  aircraft  subsystems  having  mission  debrief- 
ing periods.  This  Information  Includes: 

a.  Mission  Identification  data 

b.  Subsystem  reliability  data 

c.  Subsystem  discrepancy  write-ups. 
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2.  AFSC  Form  258,  "Maintenance  Discrepancy",  and 
AFSC  Form  258-4, ""Production  Credit  Record",  are  used  to  record: 

a.  Job  identification  data 

b.  Failed  item  data 

c.  Installed  item  data 

d.  Data  describing  discrepancy,  maintenance  required, 

and  corrective  actions. 

e.  Elements  of  the  maintenance  action 

f.  Piece  parts  replaced  during  repair. 

3.  AFTO  Form  4,  "Operating  Time  Report  for  Selected 
Items",  provides  for  periodic  elapsed  time  indicator  (ETI)  data  that  can  be 
merged  with  the  AFSC  form  258  data  file.  The  merged  data  file  provides  a list- 
ing by  part  number  and  serial  number  of  component  ETIs,  removal,  and 
replacement.  This  is  a basic  tool  from  which  component  MTBFs  may  be  com- 
puted from  operating  time,  events,  cycles,  etc.  The  following  information  is 
recorded  on  AFTO  form  4: 

a.  Aircraft-type  serial  number 

b.  Report  date 

c.  Flying  hours 

d.  Work  unit  code 

e.  Component  noun 

_f.  Component  part  number  and  serial  number. 

(d)  Output  Products  of  MISEDS. 

Thirteen  output  products  are  produced  by  the  MISEDS  pro- 
grams, as  follows: 

1.  Personnel  Subsystem  Test  and  Evaluation 

2.  Flight  Crew  Discovered  Discrepancy 

3.  258  Edit 

4.  Active  Man-Hours  Task  Summary 

5.  Maintenance  Man-Hours  per  Flying  Hour 
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6. 

Aircrew  Evaluation 

7. 

Safetj  Code 

Maintenance  Event 

9. 

AGE  Utilization 

i£- 

Action  Taken 

u. 

Component  Discrepancy 

!“• 

Subsystem  Inflight  Discrepancy 

13. 

Flying  Hours  per  Subsystem 

(c)  The  following  paragraphs,  1 through  briefly  describt' 

each  of  the  output  products.  Appendix  4-51  contains  detailed  descriptions  of 
selected  products  and  discusses  the  theory,  equations,  and  algorithms  of  the 
displayed  parameters. 

1. 

Personnel  Subsystems  Test  and  Evaluation  (PSTE) 

The  I’STE  output  report  Includes  both  1-  and  fi-month 
manpower  predictions.  In  addition,  total  number  of  tasks,  total  man-hours, 
mean  man-hours  per  task,  and  man-hours  per  flying  hour  are  presented  for  all 
Air  Force  specialty  codes  (AFSCs)  and  work  unit  codes  as  described  In  table  I-l 
of  appendix  t-iil.  WUCs  are  to  the  fifth  Indenture  level. 

2.  Flight  Crew  Discovered  Discrepancy  Iteport- 

The  Flight  Crew  Discovered  Discrepancy  Report  contains 
a convenient  chronological  log  of  mission  debriefing  data.  This  log  can  l»e  used 
to  Isolate  those  subsystems  for  which  numerous  discrepancy  indications  have 
been  x'ceorded.  Included  in  the  report  are,  for  given  WUCs,  the  total  number  of 
discrepancy  indications  for  all  missions,  the  number  of  discrepancies  per  flight 
hour  and  per  mission,  the  percentage  of  total  discrepancies,  and  a summary  of 
these  data. 


_2.  AFSC  Form  25R  Edit  Report. 

This  report  provides  a convenient  listing  for  maintenance 
data  error  checking  and  verification  of  maintenance  actions.  The  data  are 
arranged  onto  an  output  page  according  to  the  logical  sections  found  on  the 
AFSC  form  258. 


jl_.  Active  Man-Hours  Task  Summary  (AMTS)  Report. 

The  AMTS  report  provides  a valuable  tool  for  aircraft 
maintainability  assessment  by  identifying  those  areas  In  which  large  numbers  of 


hours,  man-hours,  and  maintenance  tasks  were  generated.  The  report 
presents  active  hours  per  task  (elapsed  time  from  start  to  completion  of  mainte- 
nance task,  minus  delay  time)  man-hours  per  task  (active  time  multiplied  by 
number  of  men  working  on  the  task),  active  hours  per  flying  hour,  and  man- 
hours per  flying  hour. 


5. 

Report. 

totals  and  percentages 


Maintenance  Man-Hours  per  Flying  Hour  (MH/FH) 

The  MH/FH  report  presents  line  and  shop  man-hour 
for  all  two-digit  work  unit  codes. 


6.  Aircrew  Evaluation  Reports. 

The  Aircrew  Evaluation  Report  summarizes  the  reliabil- 
ity performance  of  a number  of  flights,  and  is  used  to  isolate  subsystems  with 
reliability  problems,  to  measure  reliability  performance,  and  to  provide  input 
information  to  reliability  models.  The  report  presents  total  flying  hours  on 
each  subsystem  and  a breakdown  of  the  subsystem  malfunction  by  reliability 
code  (see  table  1-6,  appendix  4-51). 


Safety  Code  Report. 

The  Safety  Code  Report  provides  a periodic  summary  of 
malfunctions  that  adversely  affect  flight  safety,  and  includes  two  output  tables. 
One  table  lists  subsystem  names,  reliability  codes,  safety  codes,  and  narra- 
tives of  all  malfunctions.  The  second  table  presents  a summary  of  safety  code 
entries  for  each  subsystem  and  the  total  number  of  each  safety  code  recorded 
against  the  aircraft. 


8.  Maintenance  Event  Report. 

The  Maintenance  Event  Report  is  a listing  of  recon- 
structed maintenance  tasks.  All  actions  within  the  maintenance  task  are 
grouped  and  the  set  printed.  Sufficient  information  is  provided  for  each  mainte- 
nance action  and  the  complete  task  to  indicate  the  quantitative  and  qualitative 
nature  of  the  task.  Information  listed  for  each  task  includes  the  bridged  data 
fields;  the  noted  discrepancy  and  corrective  action  taken  for  each  maintenance 
action;  report/copy  number  and  date;  and  active  hours,  man-hours,  and 
elapsed  hours,  work  unit  code,  how  malfunctioned  code,  and  when  discovered 
code  for  each  action. 


9.  AGE  Utilization  Report. 

The  AGE  Utilization  Report  provides  a quantitative 
report  on  AGE  utilization  during  DT&E.  The  report  displays  AGE  operating 
time,  total  number  of  uses,  average  operating  time,  and  operating  time  per 
100  flying  hours. 
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10.  Action  Taken  Report. 

The  Action  Taken  Reports  are  utilized  to  determine 
those  subsystems  that  require  the  greatest  expenditure  of  maintenance  actions. 
Two  reports  can  be  selected:  the  Units  Summary  Report,  which  prints  the  total 
units  of  work  completed  for  each  action  taken  code  and  work  unit  code  combina- 
tion; and  the  Action  Summary  Report,  which  totals  the  number  of  occurrences  of 
each  action  taken  code  by  work  unit  code. 

11.  Component  Discrepancy  Report. 

This  report  provides  a listing  of  the  subsystem/ 
component  discrepancy  writeups  and  their  subsequent  corrective  actions.  Also 
presented  are  total  man-hours,  units  of  work,  how  malfunctioned  code,  and 
when  discovered  codes. 


12.  Subsystem  Inflights  Discrepancy  Report. 

The  Subsystem  Inflight  Discrepancy  Report  provides  a 
chronological  listing  of  discrepancy  writeups  recorded  against  specific  aircraft 
subsystems. 


13.  Flying  Hours  per  Subsystem  Report. 

This  report  provides  tables  of  subsystem  utilization 
rates.  The  output  includes  monthly  and  yearly  flying  hour  totals,  and  grand 
totals. 


(f)  From  the  above  discussion,  it  may  seem  that  the  usefulness 
of  MISEDS  is  limited  to  the  information  contained  in  the  13  products  mentioned. 
Such  is  not  the  case.  Arrangements  can  be  made  (usually  at  some  cost)  to  have 
programs  written  that  will  sort,  select,  compile,  and  compute  the  data  elements 
contained  in  the  MISEDS  history  tapes,  in  almost  any  desired  manner.  Pro- 
grams can  be  written  to  introduce  new  types  of  information  into  the  computer. 
Storage  and  handling  of  this  new  data  in  any  desired  manner  can  also  be  imple- 
mented. Utilizing  the  above  capabilities,  logistics  parameters  can  be  com- 
puted that  will  meet  nearly  any  desired  definition,  criteria,  and  computational 
procedure. 

(10)  Maintenance  Management  Information  and  Control  System  (MMICS). 
(a)  Objectives  and  Scope  of  MMICS. 

1.  Objectives. 

MMICS  was  designed  to  update  existing  maintenance 
management  and  data  collection  systems  of  the  Air  Force.  The  new  system 
enables  base-level  maintenance  managers  to  utilize  their  assets  (personnel, 
equipment,  facilities,  and  materiel)  more  effectively  by  providing  the  data 
required  for  off-base  reports  as  a byproduct  of  data  collected  during  mainte- 
nance. MMICS  reports  will  be,  for  the  most  part,  in  plain  language  rather  than 
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coded  to  look-up  tables.  Reports  will  be  generated  on  request,  rather  than 
"forced"  periodically.  Further,  all  data  provided  to  off-base  activities  by 
maintenance  will  continue  to  be  provided  in  its  current  format.  This  includes 
maintenance  data  (RCS;LOG-MMO(AR)7142),  manpower  data  (RCS;HAF-PRM(a) 
7101),  and  status  data  (RCS:HAF-LGY(D)7140). 

2.  Scope. 

MMICS  is  being  implemented  on  an  incremental  basis. 
Three  increments  encompassing  the  following  functional  areas  have  been 
defined. 


a.  Increment  1. 


Increment  1 consists  of  four  elements:  training, 
administration,  time  compliance  technical  orders  (TCTOs),  and  status. 
Incorporated  into  the  status  element  is  the  estimated  time  in  commission  (ETIC) 
monitor.  Increment  1 provides  the  capabilities  for  data  collection  and  report 
generation,  and  is  also  a segment  of  the  final  integral  part  of  the  control 
process.  Increment  1 does  not  provide  the  capability  for  extraction  of  base- 
level  data  for  command  use. 


1)  The  status  segment  is  a data  collector  and 
report  generator.  Changes  to  aircraft  status,  or  inventory  gains  and  losses, 
are  input  to  the  computer  as  they  occur.  Reports  are  generated  when  status 
limits  established  by  the  unit  are  exceeded,  or  upon  demand. 

2)  The  ETIC/event  monitor  is  the  control  seg- 
ment. The  event  monitor  is  an  internal  alarm  system  that  notifies  job  control 
of  impending  and  overdue  situations. 

3)  The  administrative  portion  of  Increment  1 
gives  maintenance  a completely  new  capability  for  controlling  manpower 
resources.  Organizational  tables,  work  center  records,  and  maintenance  per- 
sonnel records  for  each  assigned  individual  are  loaded  into  the  computer.  This 
provides  the  capability  to  generate  a variety  of  reports  to  assist  in  the  manage- 
ment of  maintenance  personnel. 

4)  The  training  management  portion  of  Increment  1 
provides  management  with  readily  accessible  report  pertaining  to  training 
status  of  individuals,  training  courses,  schedules,  etc. 

b.  Increment  2. 

The  delayed  discrepancy  file  and  operational  events 
package  is  the  second  increment  of  the  MMICS  incremental  implementation  plan. 

1)  The  delayed  discrepancy  files  portion  of 
Increment  2 encompasses  the  delayed/deferred  discrepancy  files  designated  by 
the  local  maintenance  activity. 
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2)  Discrepancy  recording  is  accomplished  on  the 
computer  on-line  using  "event"  and  "create  work  center  event"  routines.  These 
on-line  routines  record  the  discrepancy  data  in  the  prescribed  format  in  a com- 
puterized record. 

3)  Supply  data  recording  for  delayed/deferred 
discrepancies  is  accomplished  using  the  "job-supply  data”  routines.  This 
on-line  routine  source  supply  data,  i.  e. , document  number,  estimated  delivery 
date,  etc. , is  a maintenance  event  record  previously  established  by  the  event 
routine. 

4)  Several  options  are  available  for  the  retrieval 
of  event  data.  An  "event  state  inquiry"  routine  provides  the  current  status, 
excluding  supply  status,  of  a basic  event  and  each  designated  work  center  event. 

5)  Supply  requisition  inquiries  provide  status  of  an 
item  on  requisitions  for  each  equipment  ID  number.  Status  includes  the  docu- 
ment number,  status  date,  urgency  code,  and  estimated  delivery  dates. 

6)  A delayed/deferred  discrepancy  list  can  be 
produced  for  each  equipment  ID  number  on  a demand  basis.  This  routine  prints 
all  discrepancies  on  file  for  the  designated  equipment  ID,  and  includes  suj  oly 
document  numbers  for  each  discrepancy  in  an  awaiting  parts  (AWP)  status. 

7)  An  event  list  option  is  provided  that  must  be 
processed  through  a TC-521  remote  terminal  or  card  reader,  with  the  output  at 
the  line  printer  to  produce  a listing  of  the  complete  discrepancy  file  for  all 
equipment  ID  numbers.  Options  within  this  program  provide  a list  of  dis- 
crepancies for  a specific  work  center,  or  a single  equipment  ID  number;  or  for 
all  discrepancies  for  an  MDS  or  end  item  work  unit  code. 

8)  The  operational  events  portion  of  Increment  2 
accommodates  the  operational  commitments  in  the  maintenance  schedule.  The 
operational  events  portion  is  described  in  two  states:  mission  accomplishment 
and  analysis. 

a)  The  mission  recording,  also  considered  to 
be  the  scheduling  stage,  records  each  mission  (event)  in  the  computer  with  the 
scheduled  start  and  stop  date/time.  All  data  relating  to  fuel  load,  type  missions, 
estimated  flying  time,  and  a scheduled/unscheduled  indicator  are  recorded. 

b)  Mission  accomplishment  is  the  period  of 
time  from  start  to  stop  of  an  operational  event.  Start  and  stop  times  are  deter- 
mined by  the  operations/maintenance  control,  and  are  entered  in  the  machine 
during  mission  recording  as  described  above.  Prior  to  and  during  the 
accomplishment,  event  status,  operations  event  lists,  proposed  schedules,  and 
daily  mission  schedules  are  available  to  maintenance  management.  Cancella- 
tions and  delayed  events  are  recorded  using  abort,  cancellations,  and  delay 
codes  to  provide  for  subsequent  analysis  of  the  accomplishment  report. 
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c)  The  analysis  stage  provides  the  capability 
for  periodic  reports  of  mission  accomplishment,  summary  of  flying  hours, 
missions  flown  versus  missions  scheduled,  and  data  related  to  aborts,  cancel- 
lations, additions,  late  takeoffs,  substitutions,  and  delays. 

c-  Increment  3. 

Increment  3 of  MMICS  is  the  documentation  of  work 
unit  codes,  job  standards,  and  mechanized  equipment  records. 

1)  Individual  WUCs,  or  a complete  listing  of  all 
codes,  may  be  retrieved  for  a specific  t3q)e  of  equipment.  Data  relevant  to  a 
specific  standard  job,  i.e. , repetitive  maintenance  tasks,  inspection,  and  time 
changes  required  on  assigned  equipment,  may  be  retrieved.  Several  methods  of 
retrieval  are  available  for  the  mechanized  equipment  records  of  controlled  items. 
Controlled  items  are  those  managed  under  the  Advanced  Configuration  Manage- 
ment System  (ACMS),  or  items  having  an  established  inspection  or  time  change 
interval  and  are  installable  on  other  items  of  equipment.  Records  are  retriev- 
able for  each  controlled  installable  engine  or  part/serial  numbered  item.  The 
options  available  for  retrieving  eontrolled  item  records  are: 

a)  Selected  end  items.  This  option  produces 
a listing  identifying  the  requested  end  items  and  all  installed  components. 

b)  Engines  or  part-serial-numbered  items. 
This  option  may  be  used  to  obtain  the  installed  location  of  all  engines  of  the  same 
type,  or  all  serial  numbers  having  the  same  part  number. 

2)  The  retrieval  of  due-date  or  due-time  data  for 
recorded  inspections  or  time  changes  is  available  for  a selected  item  of  equip- 
ment or  for  all  items  within  the  same  equipment  designation.  A limited  fore- 
cast of  upcoming  inspections  and  time  changes  is  made  available  through  the  use 
of  the  operating  time  update  routine.  The  current  equipment  operating  time  for 
a selected  end  item  may  be  obtained  by  one  of  the  following: 

a)  Using  the  point  option  of  the  operating  time 
update  routine.  This  provides  the  current  equipment  operating  hours. 

b)  Using  the  current  operating  time  program. 
This  provides  the  current  operating  hours  recorded  for  the  requested  end  items 
and  for  each  installed  component. 

In  addition,  a pfraphic  display  of  time  remaining  to  a specific  inspection  or  time 
change  requirement  is  available  by  using  the  time  distribution  inquiry  program. 

(b)  Policy  and  Procedural  Documentation  for  MMICS. 

As  previously  stated,  MMICS  is  still  in  the  implementation 
phase.  The  document  that  most  completely  describes  MMICS  is  AFM  6R-278, 
Volumes  I through  V. 
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(c)  Data  Collection  Forms/Data  Sources. 
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The  source  data  for  MMICS  is  provided  bj'^  the  Ci03.‘i  ADS  of 
the  65-110  system.  MMICS  is  unique,  however,  in  employing  remote  terminals 
for  the  input  of  data  in  lieu  of  the  manually  recorded  and  subsequently  keypunched 
data  that  normally  provides  the  input  to  the  computer.  The  remote  TD806CRT 
or  TCr)21  keyboards  are  used  with  MMICS.  This  system  will  eventually  eliminate 
the  need  of  the  AF  form  359,  and  will  convert  the  AFU  65-110  system  to  on-line 
operation. 

(dl  Manual  Backup  System  for  MMICS. 

1.  During  the  operation  of  MMICS,  there  will  be  periods  of  ; 

time  when  the  B-3500  will  not  be  available  for  use  by  maintenance  organizations. 

These  periods  of  nonavailability  may  be  caused  by  the  necessity  of  performing 

preventive  maintenance  on  the  B-3500;  hardware  or  software  malfunctions;  or  ■ 

the  necessity  of  performing  computer  housekeeping  requirements,  e.g. , file 
j dumps,  MMICS  history  dump,  etc.  During  these  periods  of  nonavailability,  I 

i maintenance  will  continue  to  operate  using  the  manual  backup  procedures  | 

I described  below.  Essentially,  for  Increment  1,  each  function,  e.g.,  job  con-  ) 

trol,  training,  administration,  etc.,  assumes  the  communication  and  mainte-  J 

I nance  functions  of  the  computer.  The  information  normally  entered  into  the 

f computer  via  the  remotes  will  be  formatted  by  each  functional  area  on  AF 

form  1530.  After  the  computer  returns  to  an  on-line  status,  it  will  be  necessary 
I to  quickly  update  the  MMICS  files  to  the  current  status.  Each  MMICS  program 

. description  (see  AFM  66-278,  Volume  D)  has  instructions  for  file  update 

(processing.  Since  the  data  files  will  not  be  accurate  until  they  are  updated, 

inquiry  inputs  should  not  be  formatted  on  AF  form  1530  during  the  time  the  unit  i 

is  operating  in  manual  backup. 

i 

i 2.  There  are  basically  three  modes  of  updating  the  files  . 

1 once  the  computer  comes  back  on  line;  the  file  update  (FUDl  routine,  updating 

I through  the  unit's  card  reader,  and  updating  by  individually  inputting  the  trans- 

[ actions  through  the  TC-521.  While  all  three  methods  require  the  use  of  AF 

I form  1530,  the  recording  procedures  are  slightly  different  for  each.  What 

I determines  the  update  method  to  be  used  is  the  number  of  transactions  that  each  ; 

: functional  area  would  generate  during  the  time  the  computer  is  down.  Thus, 

i when  the  computer  goes  down,  a determination  should  be  made  as  to  the 

I expected  length  of  time  it  will  be  down.  Once  the  down-time  is  known,  the  host 

I unit,  in  coordination  with  tenant  MMICS  users,  will  determine  the  method  for 

updating  the  data  files  when  the  computer  is  once  again  operational.  If  there  are 
more  than  50  to  60  inputs  to  be  made  per  unit  by  the  time  the  system  comes  up, 
the  FUD  method  should  be  used.  For  quantities  less  than  50  to  60  Inputs,  the 
card  reader  or  the  TC-521  can  be  used.  Regardless  of  the  method  to  be  used, 
no  inquiry  inputs  should  be  formatted  for  processing  during  the  time  the  files  are 
being  updated.  Recording  procedures  for  each  of  the  three  methods  of  file 
updating  are  described  in  AFM  66-278,  Volume  I,  Section  F. 
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(e)  (.Xttput  Prcxiucts  of  MMICS. 

The  output  products  of  MMICS  are  identified  by  the  program 
routines  that  generate  the  out^iut  reports.  A single  routine  is  capable  of  gener- 
ation reports  in  one  of  several  formats.  The  following  paragraphs  contain 
descriptions  of  selected  output  products  available  with  MMICS.  Complete 
descriptions  of  all  MMICS  output  products  can  be  found  in  AFM  fifi-278.  Vol- 
ume II. 

1..  Kquipment  Status  Inquiry. 

The  reports  generated  by  this  routine  are  designated  to 
nrovide  as  much  data  as  possible  relevant  to  current  status  of  assigned  equip- 
ment. The  reports  are  used  primarily  to  determine  equipment  status  of  an 
equipment  designator,  a single  equipment  ID,  or  a listing  of  all  equipment  IDs 
with  a given  status  condition.  There  are  three  formats  to  this  report,  as 
follows; 

a.  Equipment  Designator  Status  Report. 

This  report  provides  status,  status  reason  code, 
WUC,  and  the  ETIC  (if  one  exists).  Location  and  configuration  code  will  be 
available  with  the  implementation  of  MMICS  Increments  4 and  5,  respectively. 
These  data  are  provided  relevant  to  all  assigned  equipment  IDs  of  the  input 
equipment  designator.  The  report  has  two  formats,  one  providing  status  and 
ETIC  data  plus  the  start  time  of  the  next  scheduled  sortie  or  sorties  for  the  day 
which  the  report  covers,  and  the  other  providing  status  and  ETIC  data  only. 

(The  next  scheduled  sortie  format  will  be  available  with  the  implementation  of 
Increment  2 of  MMICS.) 

b.  Single  Equipment  - ID  Status  Iteport. 

This  report  portrays  status  and  ETIC  data  relevant 
to  a single  equipment  ID.  The  next  scheduled  sortie  option  is  not  available  with 
this  report. 

£.  Specific  Status  Report. 

This  report  portrays  status  and  ETIC  data  for  all 
assigned  equipment  IDs  of  the  input  equipment  designator. 

2.  Equipment  Status  Routine. 

a.  The  reports  generated  by  this  routine  provide  infor- 
mation relev'ant  to  the  status  of  assigned  equipment.  In  conjimction  with  the 
Aerospace  Vehicle  Status  Report,  the  routine  that  generates  these  reports 
servos  to  eliminate  the  need  to  maintain  a file  of  reports  relevant  to  status  data, 
and  to  enhance  the  manager's  ability  to  rapidly  acquire  summarized  or  detailed 
reports  displaying  status  and  inventory  data  on  the  units  assigned  equipment. 
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b.  The  equipment  status  information  requested  may  be 
specified  as  to  time  period,  type  of  equipment,  and  type  of  report  (summarized 
or  detail).  Data  are  portrayed  in  three  different  formats; 

1)  Format  I represents  a summarized  equipment 
status  report  for  whatever  equipment  designator  and  time  period  is  input. 

2)  Format  2 provides  a summarized  equipment 
status  report  for  whatever  equipment  ID  and  time  pericxl  is  input. 

.{)  Format  3 provides  a detailed  status  report  for 
whatever  equipment  ID  and  time  period  (restricted  to  31  days)  is  input. 

£.  ETIC  Inquiry. 

This  routine  genex-ates  reports  that  portray  an  ETIC,  if 
it  exists,  for  a single  equipment  ID  of  all  ETICs  loaded  for  a given  equipment 
designator.  This  report  will  also  show,  for  each  equipment  ID  listed,  all  opei*a- 
tional  events  scheduled  up  to  and  including  the  day  and  time  of  the  ETIC. 

■I.  Individual  TCTO  Inquiry. 


The  reports  generated  by  this  routine  are  designated  to 
pi’ovide  the  TCTO  status  for  one  TCTO  on  one  item  of  equipment.  The  output 
includes  all  supplements  that  apply  to  the  TCTO. 

5.  Maintenance  Personnel  Inquiry. 


This  program  pi'ovides  the  capability  to  extx’act  selected 
data  from  an  individual  personnel  record.  The  user  has  the  option  of  selecting 
any  of  the  following; 

Ti'aining  Status/AFSC  Inquii'y 

b.  Duty  Status  Inquii-y 

c.  Accounting  Data  Inquiry 

Skill  Level  Inquiry. 

This  program  provides  management  with  a skill  level 
summai'y  for  a work  center.  The  output  gives  the  number  of  personnel 
authorized  and  assigned,  and  the  percent  manned,  in  each  skill  level. 

7.  Status  Update. 

This  I'outlne,  in  conjunction  with  the  operating  time 
update  (OTU)  routine,  totally  automates  for  aircraft  the  AFR  fir>-110  reporting 
system  in  MMICS  units.  The  routine  is  used  to  maintain  current  status  and 
status  history,  and  to  report  Inventory  gains  and  losses  for  unit  assigned  equip- 
ment. The  routine  has  essentially  two  parts;  current  status  I'eporting  and 
inventory  reporting. 
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TCTO  Data  Code  Inquiry. 

This  routine  provides  maintenance  managers  with  infor- 
mation concerning  a specific  TCTO.  This  is  an  in-line  routine  giving  the  user 
the  option  of  two  output  products,  as  follows: 

a.  Open  TCTOs. 

This  output  provides  Information  on  each  item  of 
equipment  on  which  the  TCTO  is  applicable  but  has  not  been  compiled  with. 

b.  Completed  TCTOs. 


This  output  will  list  all  items  of  equipment  upon 
which  the  TCTO  has  been  accomplished. 

9.  Work  Center  Roster. 

This  program  provides  the  capability  to  provide  a listing 
of  all  personnel  assigned  to  a work  center,  or  a listing  of  all  personnel  within  a 
work  center  authorized  to  sign  off  a "red  X". 

10.  Equipment  List. 

This  program  enables  the  maintenance  manager  to 
obtain  a current  listing  of  assigned  equipment.  The  outputs  produced  by  this 
program  will  contain  all  the  equipment  in  the  unit  or  work  center  that  is  loaded 
for  a given  equipment  designator,  specific  part  number,  or  all  part  numbers, 
dependent  upon  the  input  format  used.  The  following  is  a summary  of  the  options 
available. 


Format 


Equipment  designator  by  mission  and 
design  (MD) 

Equipment  designator  by  mission,  design, 
and  series  (MDS) 

Engines  by  type  and  model  (TMl 

Engines  by  type,  model,  series,  and 
modification  (TMSM) 

End  item  WITC  item 

All  MDS,  engines,  or  WUC  items  for  a 
unit  or  work  center 

Specific  part  number  items  for  a unit 

All  parts  for  a work  center 
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11.  Aorospacc  Vehtclo  Status  lU^port. 

a.  This  program  provides  an  outinit  to  assist  in 
monitoring  tho  operationai  and  maintenance  status  of  a particular  typo  of  aero- 
space vehicle,  or  one  item  of  equipment,  identified  by  an  equipment  ID.  This 
report  will  be  produced  for  aerospace  vehicles  possessed  by  a single  unit  and 
identified  by  MD,  MDS,  or  equipment  ID. 

b.  Depending  on  the  format  option  input,  this  program 
will  pro\  ide  a status  summary  report  by  reason  and  cause  for  a period  of 

09  days;  status  distribution  by  day  and  average  distribution  by  time,  for  Ol  days; 
or  a combinatit>n  of  status  summary  and  distribution  for  01  days.  The  program 
reviews  the  AFll  fifi-llO  sUitus  data  to  produce  the  report,  q'he  status  is  sub- 
divided into  the  following  categories; 


1)  Operationally  ready  (OR). 

2)  Not  operationally  ready  maintenancc-grounded- 
unscheduled  (NOllM/O-UNSCID 


scheduled  (NORM/O-SCHKD) 

■n 

(NORM/IO 

T') 

(NORS/C.) 


Not  operationally  i*eady  maintenance-grounded 
Not  operationally  ready  maintenance-flyable 
Not  operationally  ready  supply-grounded 
Not  operationally  ready  supply-flyable  (NORS/F) 


c.  The  reports  arc  used  to  show  the  maintenance  status 
of  aerospace  vehicles,  to  monitor  the  NORM  and  NORS  status,  to  determine 
causes  of  down  time,  and  to  help  identify  possible  changes  in  the  schedules  that 
will  provide  a smoother  flow  of  maintenance. 


12.  Maintenance  Personnel  List. 


'I’his  program  provides  listings  of  personnel  in  alpha- 
betical sequency  by  last  name,  or  numerical  sequence  by  primary  AFSC  or  man 
number.  The  output  can  ho  used  as  a reference  for  information  concerning 
assigned  personnel. 


10.  Skill  Level  Report. 

This  program  provides  management  with  a skill  level 
report  for  an  organization,  sequenced  by  individual  work  center  and  summarized 
by  organization.  The  program  extracts  the  authorized  and  assigned  totals  from 
the  manpower  resources  data  in  the  work  center  record.  This  Information  is 
computed  as  percentage  of  authorized  versus  assigned,  and  displayed  by 
officers,  airman  levels  0,7,0,  and  .1,  and  civilians. 


r 
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14.  Sorial  Number  Detail  Llstlni 


This  program  is  designated  to  provide  the  status  of  all 
TCTOs  applicable  to  a specific  item  of  equipment.  The  output  report  shows 
summarized  TCTO  data  for  the  period  of  time  indicated  in  the  input.  The  report 
is  provided  by  equipment  ID  or  part  and  serial  number. 


4-6.  QUALITATIVE  EVALUATIONS. 


This  section  presents  a structured  approach  for  qualitative  evaluation  of 
tests  applicable  to  logistics  assessment.  The  approach  is  applicable  to  the 
majority  of  test  situations,  although  the  parameters  of  Interest  may  vary.  This 
section  addresses  the  general  subject  of  qualitative  evaluations  and  their  utility 
in  logistics  assessment,  and  identifies  those  situations  requiring  qualitative 
evaluations  and  processes.  These  evaluations  should  be  considered  as  sub- 
objectives  of  the  major  areas  of  assessment:  reliability,  maintainability, 
availability,  and  logistics  supportablllty.  They  must  be  tailored  to  both  expand 
on  quantitative  assessments  accomplished  and  provide  other  separate  and 
distinct  evaluations  that  cannot  be  quantified. 

a.  Utility  of  Qualitative  Evaluations. 

(Ij  Each  test  project  will  have  unique  characteristics,  dependent 
upon  the  type  of  equipnu'nt  to  Ix'  tested;  constraints  in  terms  of  money,  man- 
power, and  time;  operational  requirements;  military  need  for  the  end  item;  and 
factors  associated  with  design,  development,  and  deployment  of  the  end  item. 

In  some  instances  it  may  be  impractical  to  run  sufficient  tests  to  obtain  statis- 
tical significance  for  evaluating  selected  parameters.  In  other  instances, 
statistical  data  arc  not  required  to  evaluate  certain  conditions.  Wlicn  these 
circumstances  exist  a qualitative  approach  must  be  utilized  in  performing  the 
evaluation. 

(2)  For  those  parameters  stated  in  qualitative  terms,  care  must  be 
taken  in  identifying  the  qualitative  measures  of  merit.  Clear  definitions  must  be 
developed  to  ensure  universal  understanding  of  their  meaning.  Once  the  selected 
qualitative  measures  of  merit  have  been  defined,  relative  measures  of  effective- 
ness can  be  established  to  letermlne  the  degree  of  attainment  for  each  measure 
of  merit.  This  could  be  accomplished  as  follows,  taking  as  an  example  the 
parameter,  "susceptibility  to  Incorrect  maintenance  actions". 

(a)  A comprehensive  definition  of  the  specific  elements  of  this 
parameter  is  developed. 

(bj  A series  of  questions  associated  with  a variety  of  mainte- 
nance actions  is  Identified. 

(cl  A checklist  type  of  questionnaire  is  developed  and  copies 
made  available  for  test  team  usage. 

(d)  Questionnaires  are  completed  for  the  variety  of  maintenance 
actions  that  are  performed  on  the  end  Item. 

(e)  All  questionnaires  are  evaluated  and  a qualitative  assessment 
of  the  parameter  is  derived. 

The  number  and  type  of  questions  to  be  developed  will  depend  on  the  parameter 
to  be  evaluated.  The  evaluation  of  some  parameters  can  be  accomplished  using 


only  a few  questions.  Others  may  require  several  pages  of  questions  to  obtain 
the  necessary  Information  for  a qualitative  judgment. 

(3)  The  first  eight  qualitative  parameters  listed  In  table  4-2g  are 
basic  elements  of  an  Integrated  Logistics  Support  (ILS)  program  for  systems  and 
equipment.  ILS  requirements  were  established  by  DoD  Directive  4100.35,  and 
were  implemented  for  the  Air  Force  by  AFR  800-8.  The  ninth  parameter  Is 
associated  with  configuration  management.  These  parameters  represent  addi- 
tional areas  that  must  be  addressed  during  OT&E.  Every  effort  should  be  made 
to  perform  some  type  of  qualitative  evaluation  of  these  parameters. 

(a)  Each  OT&E  program  will  be  different  with  respect  ot  the 
number  of  qualitative  parameters  that  can  be  evaluated.  Usually  there  can  be  an 
evaluation  of  the  maintenance  plan  and  support  concept,  and  configuration  man- 
agement. Evaluation  of  the  remaining  parameters  may  not  be  possible,  some 
limitations  and  reasons  being: 

Technical  data  development  usually  lags  hardware 
availability  by  6 to  18  months. 

2.  Test  and  support  equipment  for  an  end  item  are  not 
usually  developed  until  after  the  hardware  has  gone  into  production.  Equipment 
utilized  for  test  and  support  of  prototype  end  items  usually  reflect  factory-type 
hardware  that  may  not  be  representative  of  the  final  design. 

3.  The  quantities  of  initial  and  replacement  spares  pro- 
vided for  prototype  hardware  can  be  significantly  different  from  the  quantities 
established  for  the  production  hardware. 

4.  Supply  support  may  be  provided  by  the  contractor  for 
prototype  end  items. 

Existing  support  facilities  may  be  utilized  for  prototype 
hardware.  New  or  modified  facilities  may  be  required  for  the  production  end 
items. 


6.  Training  in  the  use  and  maintenance  of  prototype  end 
items  usually  involves  instruction  by  contractor  personnel.  Formal  training  by 
the  Air  Training  Command  (ATC)  often  starts  after  production  end  items  are 
available  in  the  inventory. 

(b)  Although  these  qualitative  parameters  have  been  listed  as 
separate  items,  there  is  considerable  dependency  among  them.  For  example, 
the  quantities  of  initial  and  replacement  spares  are  based  on  the  support  con- 
cept adopted;  and  training  is  based  on  the  various  levels  of  maintenance  to  be 
performed,  which  in  turn  are  based  on  the  maintenance  plan.  In  evaluating 
qualitative  parameters  these  dependencies  must  be  considered.  Each  test 
and  evaluation  program  will  have  different  logistics  elements  and  therefore 
different  criteria  applicable  to  these  parameters.  Test  plans  must  specify 
the  unique  characteristics  of  each  program  and  Identify  the  appropriate 
qualitative  parameters  to  be  evaluated. 
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(c)  An  IntoRi-ated  Logistics  Support  Plan  (ILSP)  is  required  lor  j 

new  Air  Force  systems  and  equipment.  This  document  delineates  im  overall  I 

plan  for  implementing  the  concepts,  techniques,  and  policies  required  to 
achieve  the  objective  of  effective  and  economical  support  of  a system  or  equip- 
ment for  its  life  cycle.  The  ILSP,  along  with  Implementation  reports  pertaining 
to  the  status  of  the  various  logistics  elements  in  the  plan,  will  provide  a base- 
line for  the  evaluation  of  most  qualitative  supportability  parameters.  However, 
all  qualitative  supportability  parameters  may  not  be  applicable  to  all  OT&E 
programs;  parameters  of  interest  will  have  to  be  selected  for  each  end  item 
under  test.  The  following  paragraphs  discuss  these  parameters,  suggest  ele- 
ments to  be  considered  in  their  evaluation,  and  reference  documents  where 
additional  information  is  available. 

Maintenance  Plan  and  Support  Concept. 

a.  New  Air  Force  programs  for  systems  and  equipment 
are  required  to  have  a maintenance  plan  as  part  of  the  ILS  effort.  This  plan  is 
prepared  to  delineate  concepts  and  requirements  for  each  level  of  maintenance  to 
be  performed  during  the  life  of  the  system  or  equipment.  The  using  command 
maintenance  concept  or  plan  must  be  compared  with  the  IliSP,  and  differences 
identified  and  resolved.  After  resolution,  the  plan  should: 

1)  Define  the  actions  and  support  necessary  to 
ensure  that  the  system  or  equipment  will  attain  a specified  operational 
capability. 

2)  Establish  specific  criteria  for  time  to  repair 
end-item  equipment,  AGE,  maintenance  skills,  and  facility  requirements. 

3)  Determine  specific  maintenance  tasks  to  be 
performed  at  each  maintenance  level  (organizational,  intermediate,  depot,  or 
contractor) . 

4)  Identify  the  workloads  and  time  phasing  for 
accomplishing  maintenance  activities. 

b.  The  Air  Force  also  requires  that  contractors  submit 
plans  for  and  perform  repair-level  analyses  on  all  contractor-furnished  end 
items.  This  plan  and  the  subsequent  analyses  will  provide  valuable  information 
concerning  the  assignment  of  maintenance  tasks  to  the  various  maintenance 
levels.  T^ese  task  assignments  are  based  on  a number  of  operational  and 
economic  constraints.  The  Optimum  Repair  Level  Analysis  (ORLA)  takes  into 
account  these  constraints  in  developing  the  support  concept  for  the  end  item. 

AFSC/AFLC  Manual  800-4,  Optimum  Repair  Level  Analysis,  provides  guidance 

and  direction  that  may  be  used  by  the  test  team  in  establishing  qualitative  i 

evaluation  criteria. 


f 
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a.  Supply  support  encompasses  all  actions  and  functions 
associated  with  acquisition,  cataloging,  packaging,  preservation,  receipt, 
storage,  transfer,  issue  and  disposal  of  spare  ;,  repair  parts,  bulk  materials. 


4-239 


illJUU  Ji  I- 


w 


T 


I 

I 

I 

consumables,  and  fuel.  These  actions  and  functions  are  associated  with  main-  ] 

talnin;;  a system  or  equipment  in  an  operationally  ready  state  under  the  diverse 
conditions  of  military  use.  The  primary  objective  of  supply  support  is  to  pro- 
vide the  correct  spares,  repair  parts,  and  supplies  at  the  time  and  place  they 
are  needed.  Functional  categories  Include  procurement,  distribution,  and 
inventory  replenishment. 

b.  In  the  OT&E  environment,  only  a portion  of  the 
above  supply  support  actions  and  functions  may  have  been  implemented  for  an 
end  item.  Some  reasons  include; 

1)  The  contractor  may  provide  maintenance 
efforts,  spares,  repair  parts,  etc.,  as  part  of  his  contract  activities. 

2)  The  test  program  may  rely  only  on  the  initial 
spares  and  repair  parts  supplied  with  the  end  item. 

3)  The  program  may  have  an  Air  Force/ 
contractor  implemented  maintenance  effort. 

4)  Some  hardware  may  be  GFE,  and  rely  on 
existing  supply  support  activities  for  those  end  items. 

c.  Air  Force  Manual  67-1,  USAF  Supply  Manual,  pro- 
vides considerable  Information  concerning  all  supply  functions  and  should  be 
used  as  a reference  for  developing  and  evaluating  qualitative  supply  support 
criteria. 

d.  In  addition,  the  following  techniques  may  be  used  to 
evaluate  supply  support.  Consumption  data  can  be  compared  with  projected 
support  requirements.  Data  should  be  collected,  compiled,  and  evaluated  to 
predict  requirements  at  the  main  operating  bases,  forward  operating  locations 
(FOLS),  and  in  the  deployed  status.  Actual  usage  data  can  be  compared  with  the 
contents  of  provisioning  documents.  Initial  Spares  Support  List  (ISSL),  War 
Readiness  Spares  Kit  (WRSK),  proposed  bench  stock  listings,  etc.  Delayed  dis- 
crepancies can  be  reviewed  to  determine  supply  Impact.  In  making  these 
assessments,  the  following  areas  should  be  measured  and  analyzed; 

1)  Not  repairable  this  station  (NllTSj  rates 

2)  Condemnation  rates 

3)  Mean  time  between  demands  (Ml'BD) 

4)  Not  operationally  ready  supply  rates,  by 
equipment  and  component  causing  NORS  condition 

5)  Cannibalization  rates,  by  equipment  and 
component  being  cannibalized 
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fi)  Comparlsott  of  consumption  rates  with 
provisioninR  documents,  ISSL,  WllSK,  bench  stock  listinRs,  etc. 


7)  Comparison  of  items  having  high  MTRD  with 
the  source  maintenance  reco\’erabillty  (SMR)  coding  and  causes  of  NOUS 
cannibali/.ations,  to  evaluate  potential  changes  in  local  repair  authorizations, 

8)  Comparison  of  projected  consumption  and 
stockage  values  with  test  experience.  Analysis  of  data  for  supply  support 
suitability  compared  with  pi’ojected  equipment  utilization  rates. 


3^.  Transportation  and  Handling. 

_a.  Transportation  and  handling  comprise  the  actions, 
procedures,  and  constraints  that  ensure  a capability  to  pi-eserve,  package, 
handle,  and  transport  all  systems,  equipment,  and  support  items.  These 
actions,  procedures,  and  constraints  are  based  on  considerations  such  as 
design,  specifications,  configuration,  geographic  and  environmental  restrictions, 
operational  analyses,  transportability  criteria,  handling  equipment  and  pro- 
cedures, and  packaging  and  preservation  concepts  and  criteria.  Air  Force 
Manual  75-1,  Transportation  of  Materiel;  Air  Force  Regulation  71-1,  Packaging 
Management  Objectives;  and  Air  Force  Regulation  80-18,  Department  of 
Defense  Engineering  for  Transportability,  provide  guidance  and  information 
concerning  transportation  and  tondllng.  These  documents  should  also  be 
used  as  references  for  developing  and  evaluating  qualitative  criteria  for  this 
parameter. 

b.  A transportation  and  handling  discrepancy  form,  or 
qualitative  Parameter  Evaluation  Sheet  (figure  4-6a),  to  record  and  document 
problems  may  be  developed  by  test  teams.  These  data  can  be  collected  by  test 
team  personnel,  compiled,  and  filed  as  reference/supportive  material.  Data 
products  can  be  obtained  from  the  MDC  system  showing  actions  with  when  dis- 
covered code  Y and/or  how  malfunctioned  code  08R.  These  occurrences  can 
then  be  investigated  as  to  the  cause.  The  following  factors  should  be  considered: 

1)  Conditions  will  be  observed  and  deficiencies 
reported  on  outsize  components  to  Identify  peculiar  requirements,  needed 
Improvements,  and  special  pi-ecautions. 

2)  Adequacy  of  provisions  for  timely  deployment  of 
support  equipment  to  forward  bases  will  be  evaluated. 

.3)  Provisions  for  transportation  and  handling  after 
delivery  from  supply,  and  the  ease  or  difficulty  of  handling  during  installation 
and  removal  actions,  will  be  evaluated.  Suitability  of  handles,  carrying 
devices,  and  protective  devices  (dust,  shock.  Impact,  moisture)  will  be 
reported. 

4)  Applicable  tables  of  allowance  (TA)  will  be  used 
to  evaluate  programmed  quantities  of  special  handling  devices,  etc. , versus 
requirements  at  main  operating  base  locations  and  at  forward  locations. 
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5)  Condition  of  items  with  shelf  life/cure  dates 
when  withdrawn  from  stock  will  be  checked. 


be  evaluated. 


G)  FOL  and  deployment  dictated  requirements  will 


4.  Technical  Data. 

a.  Technical  data  provide  the  information  necessary  to 
translate  system  and  equipment  requirements  Into  discrete  operational  end 
items;  and  subsequently,  to  develop,  produce,  deliver,  operate,  and  maintain 
the  end  items  In  a prescribed  state  of  operational  readiness.  The  timely 
development  and  distribution  of  technical  data  is  essential  to  any  OT&E  program. 
Of  primary  Importance  are  the  adequacy  and  accuracy  of  the  data.  Elements 
applicable  to  this  category  include,  but  are  not  limited  to: 

1)  Engineering  and  production  drawings 

2)  Planning,  operating,  maintenance,  and  modifi- 
cation instructions 


3)  Provisioning  and  facilities  information 

4)  Technical  specifications 

G)  Inspection,  test,  and  calibration  procedures 

G)  Equipment  operating  instructions 

7)  Packaging  and  transportation 

8)  Computer  programs  and  related  software 

9)  Audlo/vlsual  presentations  and  guidance  in 
operations  and  maintenance  of  the  end  item. 

b.  Technical  data  are  the  primary  means  of  providing 
for  effective  and  standardized  maintenance.  The  quality  of  these  data  can  be 
evaluated  by  their  accuracy,  clarity,  completeness,  and  responsiveness  to 
change.  Logistics  test  planners  and  test  team  personnel  should  be  familiar  with 
AFR  8-2,  Air  Force  Technical  Order  System. 

c.  The  evaluation  of  technical  data  can  be  accomplished 
by  test  team  members  on  a day-to-day  basis  as  the  various  publications  are  used. 
Test  team  personnel  should  participate  in  TO  verifications.  Evaluation  will 
Include  Identifying  unsatisfactory  maintenance  procedures  in  technical  data. 
Identifying  inconsistencies  with  general  hardware  TOs,  and  verifying  that  all 
safety  requirements  and  warnlng/cautlonary  notes  have  been  Incorporated  In  the 
handbooks  where  appropriate.  Bench-check-serviceable  and  could-not-dupllcate 
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: rates  can  be  analyzed  to  determine  If  Inadequate  TOs  caused  or  contributed  to 

I the  problem.  The  following  factors  should  also  be  considered: 

1)  Skill  and  experience  level  of  personnel 

2)  Whether  checklists  are  provided  where 
sequential  steps  and  the  task(s)  to  be  accomplished  make  them  appropriate 

f . 

I 3)  Whether  adequate  notes,  cautions,  and  warnings 

are  Incorporated  for  personnel  safety  and  protection  of  equipment 

4)  Usefulness  of  the  form  of  technical  data  (check- 
lists, pocket  size,  etc.) 

5)  Adequacy  of  Illustrations 

fi)  Whether  references  to  special  tools  and  test 
equipment  are  included  where  needed 

7)  Utility  of  table  of  contents  and  index 

8)  Need  for  other  TOs  and  manuals  for  reference 

I to  complete  a task  safely,  correctly,  or  efficiently 

9)  Consistency  in  Instructions,  hardware,  and 
safety  provisions  between  related  manuals 

10)  Adequacy  of  FOL  and  deployed  requirements. 

I 5.  Test  and  Support  Equipment. 

The  ability  to  perform  maintenance  and  operational 
activities  during  an  OT&E  program  is  dependent  upon  the  availability  and  per- 
I formance  of  the  required  test  and  support  equipment.  Test/support  items 

Include  tools,  metrology  and  calibration  equipment,  performance  monitoring  and 
fault  isolation  equipment,  system-peculiar  handling  devices,  special  purpose 
' support  equipment,  and  other  equipment  necessary  to  test  or  operate  the  end 

product.  The  CFE  and  GFE  peculiar  to  or  designated  for  use  with  the  end  item 
should  be  evaluated  in  terms  of  their  capacity  to  sustain  end  item  operational 
requirements. 

a.  Support  equipment  (SE)  can  generally  be  divided  into 
major  and  minor  categories,  the  distinction  being: 

1)  Unit  cost 

2)  Degree  of  risk 

^ 3)  Estimated  utilization  rate 

4)  Dependency  of  program  success  upon  C.SE 

5)  State  of  the  art  in  design  and  application 


success 


4-243 


fi)  Maintenance  concepts 


\ 


,1 

I 


N 
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7)  The  value  of  the  information  to  be  obtained 
versus  the  resource  expenditure  required  to  obtain  it, 

b.  lleliabtlity,  maintainability,  and  logistics  support- 
ability  data  can  be  kept  on  major  types  of  SE  using  the  maintenance  data 
collection  systems.  This  approach  is  implemented  by  assigning  a unique  identi- 
fication number  and  serial  number  to  each  piece  of  equipment,  which  will  be 
entered  on  the  AFTO  form  349.  These  entries,  along  with  the  applicable  VVUCs 
and  the  work  center  number,  can  provide  the  key  data  elements  needed  for  the 
evaluation  of  reliability,  maintainability,  and  logistics  supportablllty  of  the 
selected  pieces  of  equipment. 


include; 


1)  Quantitative  reliability  calculations  may 


a)  MTBF  in  operating  hours  (broken  down  by 
system,  subsystem,  component,  as  appropriate) 

b)  MTBM  in  operating  hours 

c)  MH/OH 

d)  MMTR. 

2)  Qualitative  maintainability  calculations  may 

Include  assessments  of: 

a)  Accessibility 

b)  Serviceability 

c)  Ease  or  difficulty  of  maintenance 

d)  Safety 

e)  Human  factors. 

3)  Logistics  supportablllty  assessments  may 
Include  the  following  evaluations; 

a)  Technical  data 

b)  Transportation  and  handling  equipment 

c)  Facilities  requirements 

d)  Maintenance  training 


i 


• ' 
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e)  Manpower  requirements  j 

t)  SE  for  support  equipment  ■ 

g)  Supply  support. 

c.  For  SE  that  cannot  be  evaluated  by  the  above  tech- 
niques, one  or  more  of  the  following  procedures  should  be  used: 

' 1)  Report  problems  on  the  exception  principle, 

i.e.,  as  the  equipment  is  used  and  maintained,  document  the  problems  on  a test- 
i team  developed  GSE  evaluation  form.  This  procedure  will  normally  be  used  for 

nonpowered  GSE. 

2)  Review  AFTO  form  454,  "Nonpowered  AGE 

Record  for  Scheduled  and  Unscheduled  Maintenance  Actions"  ■ 

; i 

3)  Review  and/or  accomplish  AFTO  form  443,  | 

1 "Tralner/AGE  Status  and  Operating  Record";  and  AFTO  form  444,  "Tralner/AGE  ! 

i Maintenance  Record  for  Scheduled  and  Unscheduled  Maintenance  Actions".  AFTO 

1 form  95,  "Significant  Historical  Data",  may  be  used  as  required  to  record 

* cumulative  data. 

I 

j 4)  A GSE  historical  logbook  may  be  kept  on 

1 selected  items  of  intermediate  GSE,  with  the  following  items  recorded: 


a) 

Power-on  time 

(clock  hours) 

b) 

In-commisslon/out-of-commission  time 

c) 

NORS-W  time  and  part(s)  causing  NORS-W 

d) 

LRUs  tested,  by  serial  number 

failed,  etc.) 

e) 

LRU  test  results  (go/no-go  test(s) 

Calibration  time  (user  and  PMEL) 

clock  hours) 

g) 

Corrective  maintenance  time  (man-hours/ 

clock  hours) 

b) 

Preventive  maintenance  time  (man-hours/ 

1) 

Any  outside  help  (technical  representative. 

etc.)  required  to  maintain,  calibrate,  and  set  up  the  test  set  (brief 
description,  etc.) 


j)  Parts  consumption. 


f 
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d.  In  conjunction  with  the  evaluation  of  either  type  of 

I SE,  the  following  factors  must  be  considered. 

I 

1)  Suitability  for  deployment  and  FOL  operations 

2)  Ease  or  difficulty  of  operation 

3)  Effectiveness  In  troubleshooting  and  performing 

diagnostic  functions 

4)  Safety 

5)  PMEL  requirements 

6)  GSE  for  GSE 

7)  Handling  ease 

8)  Human  factors 

9)  Susceptibility  to  damage 

10)  Inspection  Intervals 

11)  Susceptibility  to  contamination 

12)  Need  for  dedicated  units  because  of  nonstandard 

fluids 

13)  Braklng/parklng  provisions 

14)  Towing  provisions 

15)  Compatibility  with  equipment  supported 

16)  Performance  efficiency 

17)  Corrosion. 

e.  The  following  areas  warrant  special  attention  during 
evaluation,  and  should  be  reported: 

1)  GSE  demonstrating  poor  MTBR,  MTBM,  or 

excessive  MH/OH 

2)  Excessive  MMTR 

.3)  Problems  with  accessibility,  serviceability, 
difficulty  of  maintenance,  safety,  and  human  factors. 
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f.  Logistics  supportabillty  assessments  will  be  made 
of  technical  data,  transportation  and  handling  equipment,  facilities  require- 
ments, maintenance  training,  manpower  requirements,  GSE  for  GSE,  and 
supply  support,  and  problems  reported. 

fi.  Support  Facilities. 

a.  Support  facilities  encompass  the  physical  plants  nec- 
essary to  sustain  the  operation  of  an  end  item.  Facility  type,  location,  space 
requirements,  environment,  and  usage  are  based  on  engineering,  operational, 
and  maintenance  requirements  as  defined  by  specifications,  end  item  design, 
and  other  related  factors.  AFM  86-2,"Standard  Facility  Requirements",  may  be 
useful  for  evaluating  additive  facility  requirements. 

b.  Elements  to  be  considered  in  evaluating  support 
facilities  include,  but  are  not  limited  to; 


1)  Base  expansion  in  terms  of  runways,  communi- 
cations, traffic  control,  launch  facilities,  security  and  utilities  (e.g. , elec- 
tricity, water,  compressed  air,  heating  and  ventilation,  sewers  and  drainage). 


2) 

Engine  test  cells,  including  location 

location 

3) 

Run-up  pads  and  sound  suppressors,  including 

•i) 

Fuel  cell  docks  and  repair  shops 

3) 

Hangar  and  maintenance-shop  floor  space 

peculiar 

6) 

Special  maintenance  facilities  that  are  end-item 

7) 

Simulators  and  other  training  aids 

8) 

Wash  racks,  corrosion  control  facilities,  hoists. 

boreslght/alignment  facilities.  Inspection  docks 

9)  Weapon  storage,  handling,  routing,  holding 
area,  and  security  programs;  trucks,  trailers  and  hauling  equipment;  war 
reserve  spares  kit  (WRSK)  storage 

10)  Construction  scheduled  and  end  item  initial 

operational  capability  (IOC) 

11)  Projected  utilization  rate 

12)  Average  sortie  length 


t 


I 

i 

< 

I 

1 
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13)  Average  number  of  engine  changes  per  month, 

scheduled  and  unscheduled 


14)  Number  of  aircraft  per  squadron,  and  squadrons 

per  wing 

15)  PME  authorizations 

Ifi)  Total  SE  authorized  per  unit  by  type 

17)  NDI  facility  requirements 

18)  Clean  room  requirements 

19)  Maintenance  requirements 

20)  Inspection  requirements 

21)  Corrosion  control  requirements 

22)  Proposed  unit  detail  listing  (UDL) 

23)  Projected  fuel  cell  requirements 

24)  FOL  and  deployment  requirements. 


7.  Training. 

a.  Objectives  of  a training  program  are  to  provide 
trained  personnel  with  specific  skills  and  training  equipment  that  will  support  an 
end  item  through  its  life  cycle.  Support  specialties  and  skill  levels  required  to 
perform  base-level  tasks,  as  well  as  the  need  for  new  or  unique  specialties,  are 
usually  defined  in  the  personnel  requirements  portion  of  the  maintenance  plan. 
Training  of  personnel  to  meet  these  requirements  will  depend  on  such  factors  as: 


1)  The  availability  of  support  specialties  and  skill 

levels  within  the  Air  Force. 

2)  System-unique  characteristics  that  require  new 
specialties  or  training  to  support  end  item  maintenance  and  operations. 

b.  The  qualitative  evaluation  should  assess  the  adequacy 
of  the  training  prior  to  OT&E,  as  well  as  the  technical  and  management-oriented 
training  by  specialty  that  is  necessary  to  support  the  operational  end  item.  The 
evaluation  includes  a determination  of  the  need  for  factory  training  by  a con- 
tractor (Type  I),  the  quality  and  quantity  of  formal  classroom  instruction  at  Air 
Training  Command  (ATC)  centers  (Types  n and  III),  training  that  can  be  accom- 
plished on  base  by  an  ATC  field  detachment  (Type  IV),  and  other  training 
(Type  V)  which  may  involve  intraservice  training.  Factors  for  assessing 
training  can  be  found  in  the  following  types  of  documentation. 
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U I’orsonncl  equipment  and  sMbsystojiis  tt'st  and 

ovaUiatlon  (PS'l'K)  reports 

2)  Unman  factors  enRlneorinp:  and  manaKcmont 

studies  (see  At'lt  .‘'00-ir>) 

:i)  tjualltatlvo  and  quantitative  personnel  require- 
ments information  ((.Jt^l’UI)  lists. 

e.  'the  qualitative  assessment  of  trainlnn  will  depend 
on  the  observations,  experience,  and  Judgment  of  ATC  and  usinj:  ccnnmand  per- 
sonnel partlclpatinp:  in  training:  and  OTK.K.  The  importance  of  these  experience 
and  judgment  factors  cannot  be  overcmphasl/.ed.  'I'he  main  objectives  of  the 
training  assessment  in  tlT&d'"  must  Include; 


training 

facilities  requirements 

documents 


1)  Uotormlnlng  the  adequacy  of  maintenance 

2)  Validating  training,  ixpilpment,  media,  and 

:h  Kvaluatlng  the  adequacy  of  t>q)e  I course  control 
•1)  Kvaluatlng  attrition  and  conversion  training 


requirements. 


S.  Initial  and  Replacement  Stores. 


This  parameter  is  usually  evaluated  as  an  element  of 
supply  support.  Uecause  of  its  Importance  to  an  OT&K  program,  it  has  been 
llsteti  separately,  'rhe  significance  of  this  parameter  results  from  its  direct 
impact  on  an  OT&K  program.  Without  adequate  repair  and  spare  parts,  sig- 
nificant delays  can  occur.  Some  factors  that  influence  quantities  of  initial  and 
replacement  spares  Include,  but  are  not  limited  to; 


a.  Kquipment  design 

b.  Operationally  ready  rate  requirements 

c^  Kquipment  reliability 

<1.  Maintenance  concept 

ll  Uepalr  les'cls  (organl/ational,  intermediate, 

2)  Uepalr  versus  discard  of  modules 

Uemove  ami  replace  versus  remove  and  repair 


i 

i 
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OT&K. 


Support  equipment  and  facilities  available  for 


e.  Available  technical  documentation. 


For  additional  information  concerning  this  parameter  refer  to  AFM  07-1, 

USAF  Supply  Manual. 

9.  Configuration  Management. 

a.  The  configuration  management  effort  presents  a 
series  of  design  baselines  that  provide  orderly  transition  from  one  decision 
point  to  the  next  in  the  design,  development,  and  evaluation  of  an  end  item. 
Configuration  management  interfaces  with  logistics  through  the  development  of 
technical  data  that  affects  the  planned  logistics  suppoi't  resources.  As  the  con- 
figuration baselines  are  refined,  the  logistics  baseline  must  be  adjusted.  The 
logistics  support  delivered  to  sustain  operational  equipment  must  be  adjusted  to 
match  the  product  baseline  that  exists  at  the  time  the  equipment  is  put  into 
OT&E.  Subsequent  configuration  management  decisions  will  usually  impact  the 
logistics  support  system. 

b.  This  parameter  should  be  evaluated  in  terms  of  how 
well  the  logistics  resources  support  the  configuration  under  test.  The  inter- 
actions among  the  various  supportability  parameters  will  influence  the  qualita- 
tive assessment  of  configuration  management  adequacy.  Since  each  program  will 
be  different,  so  will  the  qualitative  criteria.  For  each  (Tl'&E  program  the 
criteria  must  be  established  by  the  similarity  and  differences  of  the  test  item  to 
end  items  in  the  inventory. 

£.•  Paragraph  4-3a(4)  provides  an  overview  of  configu- 
ration management  and  lists  documents  pertaining  to  the  subject  that  should  Ix' 
used  in  establishing  criteria  for  the  evaluation  of  this  qualitative  parameter. 

(4)  Additional  parameters  that  may  also  require  qualitative  assess- 
ments are  presented  in  table  4-fia.  These  parameters  are  generally  considered 
as  qualitative  subobjectives  of  the  maintainability  analysis  portion  of  testing. 

They  support  and  are  supported  by  the  quantitative  maintainability  objectives. 

The  following  paragraphs  provide  a discussion  of  each  of  these  listed  parameters. 

(a)  Accessibility  of  Parts.  Test  Points,  Adjustments,  and 
Connections.  Maintenance  performed  during  testing  should  be  evaluated  by  the 
technician  performing  the  task.  Problems  related  to  maintainability,  equipment 
design,  installation,  accessibility,  location,  or  servicing  should  lx*  identified  by 
test  team  members  and  documented  on  a locally  designed  maintainability'  evalu- 
ation form.  These  forms  can  be  filed  by  WUC  and  used  as  reference  documenta- 
tion in  the  preparation  of  deficiency  reports.  Emphasis  should  be  placed  on 
identifying  the  human  factors  in  equipment  designs  that  may  lead  to  maintenance 
errors  and  hazardous  conditions,  such  as  electrical  leads  that  can  be  reversed; 
fittings  that  arc  co-located  and  could  be  attached  to  the  wrong  connection;  shai-p 
edges;  blind  spots;  exposed  electrical  contacts;  etc.  For  problems  in  such 
characteristics  as  accessibility,  location,  and  servicing,  which  cause  excessive 
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TABLE  4-Cki.  QUALITATIVE  PARAMETERS 

1.  Accessibility  of  parts,  test  points,  adjustments,  and  connections. 

2.  Test  instrumentation  effects  on  end  item  performance. 

3.  Accessiblllty/adaptablllty  for  In-fllght  maintenance. 

4.  Design-dictated  or  permitted  preventive  maintenance 
actions. 

5.  Proliferation  of  special  maintenance  tools. 

6.  Susceptibility  to  incorrect  maintenance  actions. 

7.  Susceptibility  to  damage. 

8.  Adequacy  of  safety  and  protective  equipment. 

9.  Adeqiiacy  of  standardization  and  interchangeability  features. 

10.  Adequacy  of  security. 

11.  Adequacy  of  fail-safe  design  features. 

12.  Adequacy  of  corrosion  prevention  and  control. 

13.  Adequacy  of  time  change  procedures. 

14.  Inspection  criteria. 

13.  Adequacy  of  post-maintenance  operational  check. 

10.  Special  handling  criteria. 

17.  Size  and  weight  limitation  criteria. 

18.  Environmental  extreme  criteria. 

19.  Weapon  load  criteria. 

20.  Alignment  and  calibration  criteria. 

21.  Cyclic  operation/duration  limits  criteria. 

22.  Mission  variation  criteria. 

23.  Human  factors  engineering. 


man-hours  to  be  expended  or  excessive  downtime,  stopwatch  measurements 
should  be  made  to  determine  the  time(s)  for  the  total  task  and  the  portion  of  that 
time  which  can  be  attributed  to  the  problem  In  question.  Problems  with 
accessibility,  and  serviceability  can  be  related  by  WUC  to  excessive  MH/FH, 
MMTIl,  etc.  Once  a task  Is  identified  as  consuming  excessive  maintenance 
time  because  of  accessibility  or  location  problems,  the  test  team  should  calcu- 
late, by  the  most  suitable  means  appropriate,  that  portion  of  the  task  time 
attributable  to  the  faulty  design  or  installation  characterlstic(s).  This  time  can 
then  be  subtracted  from  the  present  task  Interval  to  determine  the  amoiuit  of 
time  that  could  be  saved  by  redesign.  These  data  are  then  used  In  conjunction 
with  cost-of-ownership  calculations  to  evaluate  the  cost  impact  of  a redesign  in 
terms  of  savings  from  an  improved  maintenance  standpoint. 

(b)  Test  Instrumentation  Effects  on  End  Item  Performance.  The 
utility  of  this  parameter  is  to  ensure  that  the  possible  effects  of  test  instrumen- 
tation have  been  isolated  from  the  end  item.  If  Isolation  cannot  be  accomplished, 
these  effects  must  be  known  and  controlled.  Typical  examples  are  excessive 
power  drain  when  test  instrumentation  uses  end  item  power;  a variety  of  prob- 
lems associated  with  telemetry  equipment,  ranging  from  signal  interference  to 
inaccurate  data  transmissions;  and  effects  on  test  data  accuracy  caused  by 
computer  controlled  test  equipment  and  the  interactions  between  test  equipment 
and  end  item. 


(c)  Accessibility/Adaptability  for  In-Flight  Maintenance. 

In  selected  cases,  some  limited  type  of  in-flight  mainte- 
nance may  be  practical.  For  example,  in  multi-manned  aircraft,  spare  LRUs 
may  be  carried  in  accessible  electronics  racks  to  permit  in-flight  removal  and 
replacement  of  failed  items  during  a mission.  The  access  to  and  the  resetting 
of  circuit  breakers  for  flight-critical  equipment  may  also  be  necessary. 

2.  In  other  instances  the  performance  of  actual  in-flight 
maintenance  may  not  be  a factor  in  evaluating  an  aerospace  vehicle.  However, 
manual  switching  from  primary  to  backup  or  emergency  systems  may  be  critical 
to  flight  safety.  The  controls  for  performing  these  switching  functions  must  be 
readily  available  to  the  pilot.  Built-in  test  equipment  displays  should  be  easily 
read  so  that  the  pilot  can  assess  the  extent  of  the  indicated  malfunction  and 
Implement  any  corrective  actions  available  to  him. 

(d)  Design  Dictated  or  Permitted  Preventive  Maintenance 
Actions.  The  purpose  of  evaluating  this  parameter  is  to  determine  the  adequacy 
of  the  actions  established  for  the  preventive  maintenance  program.  Preventive 
maintenance  comprises  those  actions  performed  on  a regular  basis  (time,  miles, 
cycles,  events)  to  assure  that  an  end  item  has  not  deteriorated  below  some 
acceptable  operating  condition.  Periodic  inspections,  lubrication,  checks  for 
worn  or  damaged  parts,  and  scheduled  replacement  of  parts  and  equipment 
before  failure  are  some  of  these  actions.  Additionally,  where  status  monitoring 
equipment  is  utilized,  the  validity  of  established  limits  for  maintenance  should 
be  verified,  as  should  the  limits  and  tolerances  specified  in  the  technical  data. 
Methods  should  be  explored  for  reducing  servicing  and  maintenance  costs 
through  approaches  that  are  equally  safe  but  more  efficient. 
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(e)  Proliferation  of  Special  Maintenance  Tools.  This  parameter 
is  associated  with  the  quantities  of  special  tools  required  to  perform  mainte- 
nance actions  on  a specific  end  item.  Requirements  for  special  tools  may 
affect  the  level  (organizational,  intermediate,  depot)  at  which  the  maintenance 
actions  can  be  performed.  In  turn,  these  levels  Impact  on  the  overall  mainte- 
nance concept.  Actions  that  could  be  performed  at  the  organizational  level  may 
require  moving  to  intermediate  or  depot  levels,  depending  on  the  necessary 
tools  and  their  locations.  The  utility  of  this  parameter  is  in  reviewing  the 
maintenance  actions,  the  types  and  quantities  of  special  tools  developed,  their 
applications  and  locations,  and  identifying  possible  changes  or  techniques  in 
maintenance  that  may  reduce  their  numbers. 

(f)  Susceptibility  to  Incorrect  Maintenance  Actions.  This 
parameter  provides  an  assessment  of  the  design  with  respect  to  malfunctions  or 
failures  induced  by  maintenance  actions,  and  is  used  as  the  example  presented 
in  subsection  4-6c. 

(g)  Susceptibility  to  Damage.  This  parameter  provides  an 
assessment  of  a design  with  respect  to  possible  damage  from  sources  external  to 
the  item.  Typical  elements  to  be  considered  include  the  type,  location,  and 
adequacy  of  handles  and  hoist  attachment  points;  the  size  and  weight  of  the  item 
and  its  height  above  ground;  the  number  of  personnel  assigned  for  removal  and/ 
or  Installation  of  the  item;  clearances  between  the  item  and  access  panels  or 
doors;  the  proximity  of  other  hardware  items,  and  their  possible  inter- 
ference during  removal  or  installation;  packaging  of  the  item  including  exten- 
sions such  as  lugs  or  fittings  beyond  the  basic  dimensions  of  the  item;  mounts 
incorporated  for  shock  reduction  or  isolation;  gaskets,  seals,  and  covers 
required  for  weather  proofing;  and  containers  supplied  for  transporting,  ship- 
ping, and  storage  of  the  item. 

(h)  Adequacy  of  Safety  and  Protective  Equipment.  This  param- 
eter covers  a broad  spectrum  of  areas  that  may  require  evaluation.  Included  are 
crew  station,  arresting,  protection,  fire  extinguisher/suppression,  crash  pro- 
tection and  escape/survival,  hazard  detection  and  warning,  and  life  support 
systems.  AFSC  has  developed  a series  of  design  handbooks  covering  the  design 
and  safety  aspects  of  these  and  other  systems.  Valuable  information  applicable 
to  this  parameter  are  provided  by  AFSC  Design  Handbook  (DH)  1-G,  System 
Safety.  DH  2-2,  Crew  Stations  and  Passenger  Accommodations.  DH  1-X,  Check- 
list of  General  Design  Criteria,  and  DH  2-X.  Checklist  ior  Aeronautical 
Systems.  These  handbooks  should  be  used  when  developing  evaluation  criteria 
and  preparing  evaluation  sheets. 

(1)  Adequacy  of  Standardization  and  Interchangeability.  A 
relative  measure  of  the  degree  of  standardization  utilized  in  a design  may  be 
obtained  by  comparing  the  quantities  of  government  standard  and  stocked  articles 
or  the  number  of  new  and  unique  articles  with  the  total  articles  used  in  an  item. 
These  comparisons  may  be  made  at  the  assembly,  subsystem,  system,  or  end 
item  level.  The  use  of  government  standard  and  stocked  items  also  Impacts  on 
interchangeability.  However,  Interchanageablllty  Includes  other  factors,  such 
as  utilizing  the  same  configuration,  utilizing  existing  hardware  to  perform  new 
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or  different  functions  that  are  within  its  design  capabilities,  utilizing  standard 
mounting  hardware  and  connections  for  equipment,  and  reducing  the  require- 
ments for  special  plumbing  by  using  flexible  lines  and  hoses. 

(j)  Adequacy  of  Security.  This  parameter  is  associated  with  the 
protection  of  classified  equipment  designs  and  the  prevention  of  unauthorized  use 
of  that  equipment.  Both  of  these  aspects  of  security  must  be  evaluated. 

Elements  to  be  considered  include  the  importance  of  the  equipment  to  national 
security;  the  physical  installation  and  accessibility  of  the  equipment;  provisions 
for  locks,  control  of  access  keys,  and  the  suitability  of  warning  devices;  the 
authorization  and  control  of  personnel  to  access/operate  the  equipment;  and  the 
availability  of  secure  areas  for  maintenance  performance. 

(k)  Adequacy  of  Fail-Safe  Design  Features.  This  parameter 
may  be  evaluated  as  part  of  the  safety  effort.  However,  it  is  addressed 
separately  because  of  its  influence  on  equipment  design.  Some  typical  items  to 
be  considered  include  the  capability  of  extending  the  landing  gear  after  a 
hydraulic  failure;  disarming  and  securing  or  jettisoning  weapons  after  an  elec- 
trical failure;  jettisoning  fuel  if  excess  weight  is  a problem  prior  to  an  emergency 
landing;  manually  overriding  automatic  fuel  management  systems;  manually 
switching  to  emergency  electrical  power  when  primary  sources  fail;  and  reduc- 
ing power  consumption  to  a minimum  during  flight  emergency  conditions. 

(l)  Adequacy  of  Corrosion  Prevention  and  Control.  This  param- 
eter provides  an  assessment  of  the  end  item  design  with  respect  to  retaining 
structural  and  operational  integrity  in  those  areas  where  corrosion  and/or 
electrolytic  action  may  occur.  Elements  to  be  considered  include  the  use  of 
protective  coatings;  their  suitability  and  ease  of  application;  the  presence  and 
locations  of  drain  holes  to  prevent  moisture  entrapment;  the  isolation  of  and 
protection  between  dissimilar  metals;  accessibility  of  possible  corrosion  areas 
for  inspection;  the  location,  design,  and  Isolation  features  of  battery  compart- 
ments; the  use  of  solvents  and  frequency  for  washing/cleaning;  and  provisions 
for  wash  racks,  facilities,  etc.,  required  for  corrosion  control. 

(m)  Adequacy  of  Time  Change  Procedures  and  Inspection 
Criteria.  Both  of  these  parameters  are  linked  to  the  failure  or  malfunction 
expectancies  of  hardware  and  the  relative  risks  associated  with  these  malfunc- 
tions or  failures.  Some  malfunctions  or  failures  may  always  result  in  the  loss 
or  destruction  of  an  end  item.  Others  may  contribute  to  degraded  performance, 
and  still  others  may  present  only  nuisance-type  problems.  In  assessing  these 
two  qualitative  parameters,  it  is  Important  to  identify  the  criticality  of  failures 
or  malfunctions  with  respect  to  their  Impact  on  end  item  operation.  Then  each 
parameter  is  evaluated  in  terms  of  its  potential  for  discovering,  reducing,  or 
preventing  those  types  of  failures. 

(n)  Adequacy  of  Post-Maintenance  Operational  Check.  Generally, 
this  item  would  be  included  as  part  of  the  evaluation  of  susceptibility  to  incorrect 
maintenance  actions  (para.  4-6a(4)(f).  However,  it  is  listed  separately  because 
it  may  require  a specific  assessment.  The  technical  documentation,  checkout 
procedures,  input-output  characteristics  and  tolerances,  seals,  fasteners. 
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lubrication,  external  wiring  and  connectors,  and  bleeding  and  purging  are  some 
of  the  elements  to  be  considered  in  evaluating  the  adequacy  of  checkout  pro- 
cedures that  verify  the  sufficiency  of  the  maintenance  performed.  A further 
breakdown  between  on-equipment  and  off-equipment  operational  checkout  may 
also  be  required. 

(o)  Special  Handling  Criteria  and  Size  and  Weight  Limitations. 
While  these  two  items  are  normally  considered  during  the  evaluation  of 
susceptibility  to  damage,  para.  4-(>a(4)(g),  they  are  listed  separately  here  as 
possible  parameters  requiring  specific  assessments.  Special  handling  criteria 
include  items  such  as  packaging  and  preservation  for  handling  and  transporta- 
tion, shelf  life,  controls  for  protecting  classified  equipment,  environmental 
and  shock  load  protection  during  shipment  and  storage,  and  susceptibility  to 
contamination.  Size  and  weight  limitation  criteria  Include  maximum  length, 
width,  and  depth;  maximum  weight;  end  item  structure  available  to  support  hard 
ware;  size  of  space  and  clearances  provided  for  removal  and  installation  of 
hardware;  and  equipment  and  crew  necessary  to  remove  and  Install  hardware. 

(p)  Environmental  Extremes  Criteria.  During  the  evaluation  of 
this  parameter,  both  natural  and  man-made  environments  must  be  considered. 
Natural  environment  includes  sueh  factors  as  temperature,  atmospheric  pres- 
sure, humidity,  rain,  snow,  sand  and  dust,  and  wind.  The  man-made  environ- 
ment includes  temperature,  altitude,  acceleration,  pressure,  and  mechanical 
and  acoustic  vibrations. 

(q)  Weapon  Load  Criteria.  These  criteria  dictate  the  tjT^s  of 
specialists,  crew  sizes,  and  number  of  crews  required  to  perform  the  weapon 
loading  functions.  Factors  to  be  considered  when  evaluating  this  parameter 
Include  the  diversity  of  armaments  to  be  serviced,  loading  sequences,  sortie 
turnaround  time,  weights  of  individual  stores  to  be  loaded,  available  equipment 
for  stores  transportation  and  handling,  repetition  of  tasks  and  fatigue  factors, 
maximum  number  of  personnel  that  can  effectively  work  in  the  loading  area, 
personnel  and  equipment  safety  regulations,  hazards  associated  with  the  dif- 
ferent types  of  stores,  and  security  requirements  associated  with  classified 
weapons. 


(r)  Alignment  and  Calibration  Criteria.  Elements  to  be  con- 
sidered in  evaluating  this  parameter  Include  the  physical  characteristics  of  the 
precision  measurement  equipment,  including  packaging,  size,  weight,  cables 
and  probes,  and  ancillary  equipment;  traceability  to  appropriate  reference 
standards;  alignment  and  calibration  Intervals  and  certification  requirements; 
operational  environmental  tolerances;  storage,  handling  and  transportation 
requirements;  calibration  measurement  requirements  and  restrictions;  appli- 
cable technical  orders  and  calibration  procedures;  alignment  and  calibration 
responsibilities;  personnel  technical  skills  and  proficiency  requirements;  and 
security  requirements  and  restrictions  for  classified  equipment. 

(s)  Cyclic  Operation/Duration  Limits  Criteria.  Test  and  check 
out  of  selected  equipment  usually  requires  the  presence  of  system  power.  In 
many  instances  the  application  of  power  activates  the  complete  system.  Under 
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these  conditions,  even  when  only  a portion  of  the  system  is  under  test,  the 
complete  system  is  accumulating  operating  time  and  is  subject  to  failures. 
Additionally,  power-on  test  situations  may  cause  excessive  temperature  buildup 
and  result  in  malfimctions  or  failures  In  portions  of  the  system  not  being  tested. 
Special  instructions  for  additional  cooling,  cycling,  or  time  limits  may  be 
required  for  power-on  test  situations.  The  system  design  may  be  such  that  por- 
tions of  the  system  may  be  isolated  or  rendered  inoperative  when  not  being 
tested.  The  purpose  of  this  parameter  is  to  identify  the  possible  adverse 
effects  that  testing  may  have  on  the  hardware,  and  the  adequacy  of  the  pre- 
ventive measures  implemented  for  equipment  protection  during  power-on  testing. 

(t)  Mission  Variation  Criteria.  Multi-mission  capabilities  are 
generally  provided  by  using  different  types  and/or  combinations  of  on-board  end 
item  hardware.  The  purpose  of  this  parameter  is  to  assure  that  those  sub- 
systems operating  during  each  mission  have  been  identified.  The  development  of 
a matrix  showing  missions  versus  equipment  requirements  is  one  method  of 
evaluating  this  parameter.  The  matrix  also  has  the  advantage  of  providing  a 
method  for  identifying  alternate  or  reduced  mission  capabilities.  Rased  on  the 
status  of  hardware  at  any  point  in  time,  the  missions  that  are  still  possible  can 
be  identified.  Care  must  be  taken  in  using  this  approach,  because  the  practicality 
of  reduced  capabilities  may  be  exceeded. 

(ul  Human  Factors  Engineering  (HFE).  IIFE  is  concerned  with 
those  tasks  required  to  provide  effective  human  performance  in  a system.  It 
comprises  that  portion  of  systems  optimization  associated  with  the  human  per- 
formance necessary  to  operate,  maintain,  support,  and  control  the  system  in  its 
intended  operational  environment.  The  elements  comprising  HFE  include  human 
engineering,  biomedical,  manpower  and  personnel  requirements,  and  training. 
Because  there  are  overlaps  among  disciplines,  three  of  these  elements  have  Ix'en 
previously  discussed.  Training  and  personnel  requirements  were  covered  under 
ILS,  and  the  majority  of  biomedical  items  were  presented  under  safety  and  pro- 
tective equipment  adequacy. 

U Human  engineering  is  the  application  of  knowledge  con- 
cerning human  capabilities  and  limitations  to  equipment  or  system  designs  such 
that  desired  results  can  be  achieved  through  the  most  effective  use  of  man's 
performance  capabilities. 

2.  Items  to  be  considered  when  evaluating  human  engineer- 
ing include,  but  are  not  limited  to; 

a.  VTsion,  which  involves  field-of-view  visual  range 
requirements:  windshield  materials  and  coatings;  defogging/cleaning  provisions: 
clearance,  deviation,  distortion  and  glare;  seats  and  seating  arrangements; 
approach  and  landing  paths;  and  landing  and  delivery  areas. 

b.  Static  and  dynamic  anthropometries,  which  includes 
size,  shape,  and  motion  characteristics  of  crew  members. 
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c.  Equipment  layout,  which  Involves  panel  heights  and 
sizes;  types,  sizes,  and  locations  of  displays;  lighting;  size,  shape  and  location 
of  controls;  and  left-hand  and  right-hand  operational  tasks. 

d.  Operator  workload,  which  refers  to  the  effects  on 
the  human  operator  generated  by  the  multiple  stresses  resulting  from  the  man- 
machine  operating  environment. 

3.  Of  primary  concern  are  those  design  features  that  could 
cither  Impact  on  operator  or  technician  safety.  Introduce  operator  or  technician 
error,  or  Increase  maintenance  task  time.  MIE-STD-1472  (9  Februai'y  1968) 
contains  specific  questions  to  be  answered  during  a human  factors  evaluation. 
Those  sections  of  the  Mil  standard  that  specifically  apply  to  the  Item  or  system 
being  ev'aluated  should  be  I’evlewed  for  all  Items  or  systems  evaluated;  those 
sections  of  the  MU  standard  covering  labeling,  anthropometry,  environment,  and 
hazards  and  safety  should  be  referenced.  To  evaluate  the  above  cited  factors,  a 
checklist  tailored  to  the  system  of  Interest  should  be  developed  by  the  test  team. 
The  following  questions  can  serve  as  a general  guide  In  developing  such  a list: 


a.  Are  major  LRUs  centrally  located  to  facllltlate  total 
system  Inspection/ checkout/troubleshooting  ? 

b.  Does  system  deslgn/lnstallatlon  contribute  to  ease 
of  maintenance  In  terms  of  location,  accessibility,  etc.  ? Consider: 


type  of  fasteners. 


1)  Size  of  access  panels/doors,  and  number  of  and 


2)  Size  and  weight  of  components,  adequacy  of 
handles  or  handholds,  requU-ed  span  of  reach,  and  height  above  or  distance  from 
work  surface. 


3)  Location  of  test  or  servicing  points  In  relation 
to  work  surface  for  test  or  servicing  equipment. 


equipment. 


4)  Adequacy  of  space  for  necessary  support 


c.  Are  test  or  servicing  points  clearly  marked  to 
reduce  chance  of  Induced  error? 


d.  Are  connectors  of  different  sizes  keyed  or  clearly 
marked  to  eliminate  swapping? 

e.  Arc  connectors  visible  and  readily  accessible  to 
reduce  chance  of  cross-threading,  etc.  ? 

f.  Are  there  hazards  In  terms  of  blind  spots,  sharp 
edges,  or  exposed  electrical  connectors/circuitry? 


f 


\ 


\ 


I 


I 

I 


g.  Can  the  system  be  checked  out  (operational  check, 
troubleshooting,  etc.)  by  not  more  than  two  technicians? 

h.  Are  support  equlpment/BITE  cues  and  Indications 
easily  read  and  understood? 

i_.  Does  system  operation  create/involve  adverse 
environmental  conditions  such  as  noxious  fumes,  high  noise  levels,  extreme 
temperatures,  exhaust  blast,  etc,  ? Conversely,  does  system  maintenance 
require  facilities  or  SE  for  heatlng/coollng,  lighting,  ventilation,  etc.  ? 

j.  VVhat  additional  features  or  requirements,  not  listed 
above,  adversely  affect'system  maintenance?  (Refer  to  MIL-STD-1472.) 

(5)  The  importance  of  utilizing  test  team  personnel  with  a wide 
variety  of  maintenance  experience  cannot  be  overemphasized.  Much  of  the  value 
derived  from  evaluating  qualitative  parameters  will  depend  on  the  background 
and  experience  of  those  individuals  developing  the  questionnaires,  collecting  the 
information,  and  performing  the  subjective  analyses  of  that  information.  To 
obtain  objectivity,  the  group  collecting  the  information  should  consist  of  per- 
sonel  other  than  those  developing  the  questions  and  analyzing  the  information. 

b.  Test  Situations  Requiring  Qualitative  Evaluations. 

(1)  Initial  Operational  Test  and  Evaluation  represents  a unique  phase 
in  the  development  cycle  of  an  end  item.  At  this  stage,  only  preproduction  or 
prototype  hardware  usually  exists.  Many  final  decisions  concerning  the  produc- 
tion hardware  have  not  been  made.  Additionally,  technical  data,  support  and 
test  equipment,  training,  supply  support,  and  a variety  of  other  elements  essen- 
tial to  end  item  operations  may  be  minimal  or  nonexistent.  Judgment  factors 
will  play  a critical  role  in  performing  any  type  of  evaluation.  From  an  AF'TEC 
standpoint,  all  elements  arc  critical  to  the  results  obtained  from  the  test  and 
evaluation  process. 

(a)  Requests  for  proposal  (RFPs),  responses  to  RFPs,  engineer- 
ing change  proposals  (ECPs),  maintenance  plans,  support  concepts,  and  other 
documents  that  define  or  describe  end  item  operation  and  support  will  have  to  Ix' 
reviewed.  This  review  will  at  least  Indicate  what  has  been  planned  for  the  end 
item.  Even  with  these  documents  available,  it  may  not  be  possible  to  investi- 
gate some  parameters. 

(b)  The  evaluation  process  may  require  the  drawing  of  inferences 
between  the  logistics  elements  provided  for  the  lOT&E  hardware  and  those  that 
will  be  provided  for  the  operational  system.  Steps  can  be  implemented  during 
lOT&E  to  obtain  some  degree  of  assurance  that  existing  and  planned  logistics 
elements  for  the  new  end  Item  will  be  adequate. 

(2)  A series  of  steps  that  provide  a systematic  approach  for  evaluat- 
ing these  elements  arc  listed  below.  All  steps  may  not  be  required  for  a given 
lOT&E  program. 
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(a)  From  prof^ram  documentation,  identify  the  logistics  elements 
necessary  to  operate  and  support  the  new  end  item. 

(b)  Determine  those  elements  that  can  be  evaluated  quantitatively, 
and  those  requiring  qualitative  assessments, 

(c)  Identify  those  elements  that  can  be  evaluated  during  lOT&E. 

(d)  Establish  whether  the  lOT&E-evaluated  elements  will  be 
quantitative  or  qualitative  in  nature. 

(e)  Identify  the  quantitative  parameters  and  proceed  as  outlined 
in  sections  4-2,  4-3,  and  4-4. 

(f)  Identify  the  qualitative  parameters,  establish  their 
evaluation  criteria,  and  perform  the  evaluation. 

(g)  Identify  those  elements  that  cannot  be  evaluated  during  lOT&E. 

(h)  Review  available  information  concerning  the  overall  opera- 
tion and  support  of  a similar  existing  end  Item. 

1.  Develop  assumptions  concerning  the  relative  adequacy  of 
logistics  elements  for  the  new  end  item,  based  on  similarities  and  differences 
between  the  two  end  items. 

2-  Compare  the  quantitative  and  qualitative  elements  of  the 
new  end  item  with  similar  elements  for  the  existing  end  item. 

3.  Evaluate  the  adequacy  of  the  remaining  logistics  ele- 
ments for  the  new  item  in  terms  of  the  adequacy  of  those  elements  applied  to  the 
existing  end  item. 

(3)  As  the  program  progresses,  Follow-On  Test  and  Evaluation 
(FOT&E)  is  usually  implemented.  This  phase  of  testing  is  also  conducted  in  an 
operational  environment  but  with  production  end  items.  The  puiTJose  of  FOT&E 
is  to  verify  operational  effectiveness  and  suitability;  and  to  provide  information 
on  organization,  personnel,  doctrine,  and  tactics.  It  is  also  conducted  to  deter- 
mine if  production  techniques  have  affected  system  performance,  operational 
suitability,  and  logistics  concepts.  In  some  instances  it  may  not  be  possible  to 
adequately  evaluate  all  logistics  elements  until  FOT&E  is  Implemented. 

c.  Application  of  the  Qualitative  Process. 

The  following  discussion  expands  on  the  general  approach  to  qualita- 
tive evaluations  presented  in  para.  4-6a(2).  The  qualitative  parameter 
"susceptibility  to  Incorrect  maintenance  actions"  will  again  serve  as  the 
example.  This  parameter  is  defined  as  any  on-equipment  or  off-equipment 
actions  causing  damage  to  or  the  malfunction  or  failure  of  an  item  as  the  result 
of  performing  preventive  or  corrective  maintenance. 
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(1)  The  types  of  questions  associated  with  maintenance  actions  will 
depend  on  the  end  item  being  tested.  Aircraft  will  require  certain  types,  CEM 
will  require  other  types,  and  ground-launched  missiles  will  require  even  dif- 
ferent types.  For  illustrative  purposes,  an  aircraft  will  be  used.  In  this 
instance,  questions  must  be  formulated  for  both  on-equipment  and  off-equipment 
actions.  Typical  questions  associated  with  on-equipment  actions  may  include: 

(a)  Are  handles,  surfaces,  and  hoist  attachment  points  adequate 
for  removal/transfer  of  equipment? 

(b)  Are  areas  clearly  marked  where  weight  can  and  cannot  be 
applied  (e.g. , "No  Step",  "Use  as  Hand  Holds",  "Not  an  Attachment  Point  for 
Lifting",  etc.)  ? Are  provisions  available  where  required? 

(c)  Can  equipment  removal  or  in-place  maintenance  actions 
damage  hydraulic/pneumatic  lines  or  associated  hardware  ? 

(d)  Can  loose  or  unanchored  equipment  damage,  break,  jam,  or 
short  surrounding  hardware?  Can  loose  hardware  be  retrieved? 

(e)  Are  mechanically  actuated  limit  switch  adjustments  critical 
with  respect  to  actuator  overtravel?  Are  they  environmentally  sealed? 

(f)  Does  the  removal  of  equipment  from  the  aircraft  require 
special  tools  and/or  fixtures  to  prevent  damage  to  surrounding  hardware? 

Are  these  tools  readily  available? 

(g)  Can  hydraulic/pneumatic  actuators  be  disconnected  when  the 
system  is  pressurized? 

(h)  Will  excessive  amounts  of  lubricant  cause  seal  leakage/ 
damage?  Equipment  damage? 

(i)  Can  flight  surfaces  (spoilers,  ailerons,  flaps,  etc.)  be 
damaged  by  movement  to  extreme  positions  when  actuators  are  disconnected? 

(j)  Are  w'ire  bundles/cables  protected  against  damage  when 
maintenance  is  being  performed  near  their  locations? 

(k)  Are  chafing  blocks/strips  an  integral  part  of  the  structure  so 
that  they  will  always  be  replaced  when  removal  and  reinstallation  of  hydraulic/ 
pneumatic  lines  are  required? 

(l)  Are  hydraulic/pneumatic  flexible  hoses  long  enough  to  allow 
the  plumbing  of  an  actuator  to  be  reversed? 

(m)  Will  a hydraulic  bleed  valve  completely  drain  the  system  if 
inadvertently  left  open? 

(n)  Are  dust  or  screw  caps  provided  to  seal  off  all  bleed  valves? 
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inoperative? 


Fi 


(o)  Can  LllUs  be  installed  in  such  a manner  that  they  will  be 


I 


I 


(p)  Can  the  improper  securing  of  fasteners  (lockwire,  washers, 
lock  nuts,  etc.)  cause  the  equipment  thej’  anchor  to  become  inoperative/ 
damaged? 


(2)  Questions  may  also  be  required  to  address  specific  items  or 
locations  on  the  aircraft  such  as  engines,  landing  gear,  control  systems,  coekpit, 
fuselage,  etc. 

(2)  TjTjical  questions  associated  with  off-equipment  actions  may 

include: 


(a)  Are  mechanieal  items  designed  so  that  assembly  can  be 
accomplished  only  when  the  part's  orientation  is  correct? 

(b)  Will  the  assembly  of  mechanieal  parts  in  a backward,  upside 
down,  or  reversed  direction  affect  operation  of  the  item?  Are  wires  coded  for 
proper  connector  inscallation  ? 

(c)  Does  the  removal  of  parts  require  special  tools  or  fixtures 
to  prevent  damage  to  surrounding  hardware?  Are  these  tools  readily  arailable? 

(d)  Are  plugs  and  connectors  keyed  so  that  interchange  is  not 

possible  ? 

(e)  Can  circuit  cards  be  installed  baekwards? 

(f)  Can  circuits  be  overstressed  by  voltages  applied  at  test 

points  ? 

(g)  Can  the  use  of  electrical  probes  short  or  damage  surround- 
ing electronic  parts? 

(h)  Can  loose  parts  internal  to  an  LliU  short,  damage,  break,  or 
jam  surrounding  components? 

(1)  Can  the  omission  of  parts  (electiTinic,  mechanical,  and  othei') 
be  easily  detected? 

(j)  If  part  substitutions  are  made,  will  they  change  the  ovitput 
characteristics  of  the  LRUs? 

(4)  Once  the  questions  have  been  generated,  the  next  step  is  to 
develop  a formatted  evaluation  sheet.  The  process  of  generating  questions  and 
developing  evaluation  sheets  Is  repeated  for  each  qualitative  parameter  of 
Interest.  Figure  4-Ga  presents  a typical  evaluation  sheet  based  on  the  questions 
presented  in  para.  4-fic(l). 
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Figure  4-6a.  Qualitative  Parameter  Evaluation  Sheet 
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obaorvationa 
Made  bv  _ 


1.  Are  hamlles,  surtM*ea.  and  hoist  attachnu-nt  (lointa  adequate  (or  removal  Transfer  o(  equipment? 

2.  Are  areas  clearlv  marked  whi're  weight  can  and  cannot  be  applied  (e.  g, , "No  Step, " 'T  ae  as  Hand 
Molds,  “ "Not  an  Attachment  Point  tor  Lifting,  " etc.  > ’’ 

Are  provisions  available  where  re(|Uii\‘d? 

3.  c'an  equipment  removal  or  in-place  maintenance  actions  damage  hvdraulic  pneumatic  lines  or 
associated  hardwan*? 

4.  Can  loost.>  or  unanchored  equipment  damage,  break,  Jam,  or  short  surrounding  hardware** 

Can  loose  hardwan-  Ik*  retrieved? 

5.  Are  mechanicaltv  actuated  limit  switch  adtustmeiits  critical  with  respect  to  actuator  overtravel? 

Are  thev  envirunmentatlv  sealed? 

ti.  Does  the  removal  o(  equipment  from  tht>  aircraft  require  special  toots  and'Or  llalures  to  prevent 
damage  to  surrounding  hardware? 

Are  tht'se  tools  readllv  available? 

7.  Can  hvdraulic  pneumatic  actuators  be*  disconnected  wtum  the  system  ta pressurised? 

(1.  Will  exL'essivt*  amounts  of  liu  ricant  ause  si*al  leakage ‘damage  ? 

Equipment  damage? 

9.  Can  flight  aurfaces  (spoilers,  ailerons,  ftaps.  etc.)  be  damaged  bv  movement  to  extreme  posi- 
tions when  actuators  are  disconnected? 

to.  Are  win*  luindlea  cables  protected  against  damage  when  maintenance  It  being  perlormed  near 
their  loeations? 

11.  Are  chafing  blocks  strips  an  integral  part  ot  ttu*  structure  so  that  (ftei  trrll  alwavs  bi*  n>placed  when 
removal  and  relnstallatlon  of  avdraullc' pneumatic  lines  an*  required? 

12.  Are  hvdraulic  pneumatic  nexlble  hoses  long  enough  to  allow  the  plumbing  of  an  actuator  to  be  reversed** 

13.  Will  a hvdraulic  bleed  valve  completely  dram  the  system  if  inadvertently  left  open? 

t4.  Are  dust  or  screw  caps  provided  to  sea)  off  all  bleed  valves? 

15.  t'an  LHl'a  be  installed  in  such  a manm*r  Chat  (hev  wtil  he  inoperative? 

16,  Can  the  improper  securing  of  fasteners  (Inckwvre,  washers,  lock  nuts.  etc.  | cause  the  equipment  thei 
anchor  to  become  inoperative  damaged? 
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(5)  Each  formatted  evaluation  sheet  should  be  reviewed  with  respect 
to  its  contents  and  requirements.  Typically,  the  review  should  Include  an 
assessment  of  the  overall  questionnaire  as  well  as  the  individual  questions. 

(a)  With  respect  to  the  evaluation  sheet,  all  answers  to  the 
following  questions  should  be  affirmative.  If  not,  consideration  should  be  given 
to  restructuring  or  limiting  its  information  content. 

1.  Are  instructions  as  brief  and  uncomplicated  as  possible? 

2.  Is  the  length  of  the  questionnaire  reasonable  ? 

2.  Does  each  question  stand  on  its  own  merits  ? 

4.  Is  the  amount  of  writing  required  of  the  recipient 
reasonable  and  held  to  a minimum? 

5.  Does  the  physical  appearance  of  the  questionnaire  convey 
the  impression  that  it  is  important? 

(b)  For  each  question  on  the  evaluation  sheet,  the  following 
checklist  should  be  applied.  Unless  every  answer  is  affirmative,  the  question 
should  be  rewritten  or  perhaps  even  deleted. 

2.  Is  the  scope  of  the  question  limited  such  that  the 
recipient  can  decide  which  personal  experience  is  relevant  to  his  answer? 

2.  Is  the  topic  of  the  question  relevant  to  the  test  program  ? 

3.  Is  the  question  limited  to  only  one  topic  or  idea  ? 

4.  Is  the  wording  of  the  question  clear  and  precise  ? 

5.  For  multiple  choice  items,  are  the  choices  mutually 
exclusive,  distinct,  and  separate? 

6.  Have  lengthy  lists  of  items  that  must  be  ranked  according 
to  preference  been  avoided? 

7_.  Have  leading  questions  that  may  bias  the  recipient  been 

avoided  ? 

8.  Will  the  answer  to  a question  provide  the  intended 

Information  ? 


(c)  The  final  step  in  developing  the  formatted  evaluation  sheet  is 
the  preparation  of  instructions  for  completion  of  that  sheet.  Relatively  few 
instructions  may  be  needed  if  the  sheet  has  been  made  self-explanatory.  It  may 
be  necessary  for  the  recipient  to  identify  the  basis  for  answers  in  terms  of  his 
background,  training,  and  experience.  Other  factors  that  can  Influence  the 
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answers  to  questions  may  also  need  Identification.  The  Instructions  should  be 
stralRhtforward  and  ns  simple  as  possible*  describe  the  utility  of  the  evaluation 
sheet,  present  Its  Intended  applications,  and  provide  the  necessary  Information 
for  completing  the  sheet. 


CHAPTER  7 


SUPPLEMENTAL  INFORMATION 


The  majority  of  backup  Information  for  this  document  Is  presented  as 
appendixes  In  Volume  II.  This  chapter  provides  the  supplemental  information 
considered  necessary  for  regular  use  of  the  document.  Section  7-1  presents  a 
listing  of  acronyms  and  abbreviations  appearing  herein.  Section  7-2  provides 
a consolidation  of  terms  and  definitions.  Section  7-3  delineates  the  references 
utilized  In  preparing  this  document,  and  thus  provides  additional  Information  on 
subjects  covered  herein. 

7-1.  ACRONYMS  AND  ABBREVIATIONS. 

ACMS  - Advanced  Configuration  Management  System 

ADC  - Air  Defense  Command 

ADPE  — Automatic  Data  Processing  Equipment 

ADS  — Automated  Data  System 

AFLC  — Air  Force  Logistics  Command 

AFM  — Air  Force  Manual 

AFO  — Accounting  and  Finance  Office 

AFR  — Air  Force  Regulation 

AFSC  — Air  Force  Systems  Command  (Air  Force  Specialty 

Code) 

AFTEC  — Air  Force  Test  and  Evaluation  Center 
AGE  - Aerospace  Ground  Equipment 

ALC  - Air  Logistics  Center 

AMTS  - Active  Man-Hour  Task  Summary 

APU  - Auxiliary  Power  Unit 

ASD  — Air  Systems  Division 

ATC  — Air  Training  Command  (Action  Taken  Code) 

AU  — Aircraft  Utilization 

AWP  - Awaiting  Parts 


BIT 


Built-In  Test 


BLIS 

— 

Base  Level  Inquiry  System 

BFA 

- 

Before  Flight  Aborts 

CEI 

- 

Configuration  End  Item 

CEM 

- 

Communication  - Electronic-Meteorology 

CFE 

- 

Contractor  Furnished  Equipment 

Cl 

- 

Configuration  Item 

CND 

- 

Could  Not  Duplicate 

CSAF 

- 

Chief  of  Staff  of  the  Air  Force 

DCP 

- 

Decision  Coordinating  Paper  (Development  Concept 
Paper 

DEN 

- 

Data  Element  Name 

DID 

- 

Data  Item  Description 

DIDS 

- 

Defense  Integrated  Data  System 

DIFM 

- 

Due  In  From  Maintenance 

DoD 

- 

Department  of  Defense 

DPD 

- 

Data  Products  Directive 

DR 

- 

Demand  Rate;  Deficiency  Report 

DSA 

- 

Depot  Supply  Activity 

DSARC 

- 

Defense  Systems  Acquisition  Review  Council 

DT&E 

- 

Development,  Test,  and  Evaluation 

ECMS 

- 

Engine  Configuration  Management  System 

ECP 

- 

Engineering  Change  Proposals 

El 

- 

End  Item 

EOC 

- 

Equipment  Operating  Cycle 

EOD 

- 

Explosive  Ordnance  Disposal  (Team) 

ERRC 

- 

Expendablllty,  Recoverability,  Repair  Category 

} 


1 
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KSlt 

— 

Equipment  Status  lluportlnK  (System) 

ETA 

- 

Exception  Time  Accounting 

ETI 

- 

Elapsed  Time  Indicator 

ETIC 

- 

Estimated  Time  in  Commission 

EUMK 

- 

Emergency  Unsatisfactory  Materiel  lleports 

FAD 

- 

Force/Activity  Designator 

FCF 

- 

Functional  Check  Flight 

FCS 

- 

Federal  Supply  Class 

FM 

- 

Flight  Hours 

FI 

- 

Failed  Item 

FUN 

- 

Federal  Item  Identification  Numlx'r 

FLU 

- 

First  Line  Unit 

Fon 

- 

Foreign  Object  Damage 

FOL 

- 

Forward  Operating  Location 

FSC 

- 

Federal  Supply  Classification 

FOT&E 

- 

Follow-on  Operational  Test  and  Evaluation 

Fun 

- 

File  Update 

GFE 

- 

Government-Furnished  Equipment 

GSE 

- 

Ground  Support  Equipment 

UFE 

- 

Human  Factors  Engineering 

I FA 

- 

In-Ellght  Aborts 

II 

- 

Installed  Item 

ILS 

- 

Integrated  Logistics  Support 

ILSP 

- 

Integrated  Logistics  Support  Plan 

IM 

- 

item  Manager 

IOC 

- 

Initial  Operational  Capability 

lOT&E 

- 

Initial  Operational  Test  and  Evaluation 

IHOS 

- 

Increase  Reliability  of  Operational  Systems 

ISSL 

- 

Initial  Spares  Support  List 

JEIM 

- 

Jet  Engine  Intermediate  Maintenance 

LAP 

- 

Logistics  Assessment  Plan 

L-COM 


LSET 


MADT 


MDCS 


MEAR 

MH/FH 

MH/OH 


Mncs 


MISEDS 


MMICS 


MMTR 


- Life  Cycle  Cost 

- Lof^stlcs  Composite  Model 

- Logistics  Effects 

- Directorate  of  Logistics 

- Logistics  Performance  Factors 

- Line  Removable  Unit  (Line  Replaceable  Unit) 

- Logistics  Support  Analysis 

- Logistic  Support  Costs 

- Logistics  Supports bility  Evaluation  Team 

- Military  Airlift  Command 

- Mean  Active  Down  Time 


MAJCOM  - Major  Command 


- Minimum  Acceptable  Reliability 

- Maintenance  Cost  System 

- Maintenance  Data  Collection  System 

- Mission,  Design  & Series 

- Maintenance  Engineering  Analysis 

- Maintenance  Engineering  Analysis  Records 

- Maintenance  Man-Hours  per  Flight  Hour 

- Maintenance  Man-Hours/Operatlng  Hour 

- Master  Item  Identification  Control  System 

- Machine  Independent  Systems  Effectiveness  Data 
System 

- Measured  Logistics  Effects 

- Maintenance  Load  Factor  (Man  Hours/Flight  Hours) 

- Maintenance  Management  Information  and  Control 
System 

- Mean  Man-Hours  to  Repair 
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MOB 

- 

Main  Operating  Base 

MOE 

- 

Measures  of  Effectiveness 

MOM 

- 

Measures  of  Merit 

MRT 

- 

Maintainability  Review  Team 

MTBD 

- 

Mean  Time  Between  Demand 

MTBF 

- 

Mean  Time  Between  Eallure 

MTBM 

- 

Mean  Time  Between  Maintenance  (Actions) 

mnu 

- 

Mean  Time  Between  Removals 

MTT 

- 

Mean  Task  Time 

Nri'TH 

- 

Mean  Time  to  Repair 

NOl 

- 

Non-Destructive  Inspection 

NHN 

- 

National  Item  Identification  Number 

NOC 

- 

Not  Otherwise  Coded 

NORM 

- 

Not  Operationally  Ready  Maintenance 

NORS 

- 

Not  Operationally  Ready  Supply 

NORS-W 

- 

SE  Out  of  Commission 

NRTS 

- 

Not  Repairable  This  Station 

OA 

- 

Directorate  of  Analysis 

OCALC 

- 

Oklahoma  City  Air  I.oglstlcs  Center 

OEM 

- 

Organization  Eleld  Maintenance 

OEMDR 

- 

Organization  Field  Maintenance  Demand  Rate 

OMB 

- 

Office  of  Management  and  Budget 

OOAI.C 

- 

Ogden  Air  Logistics  Center 

OR 

- 

Operationally  Ready 

ORLA 

- 

Optimum  Repair  Level  Analysis 

OTU 

- 

Operating  Time  Update 

owe 

- 

Owing  Work  Center 

PCN 

- 

product  Control  Number 

PCR 

- 

Publication  Change  Request 

PDM 

- 

Programmed  Depot  Maintenance 

PEC 

- 

Program  Element  Code 

PER 

- 

Premature  Engine  Removals 
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PKSTK 

— 

Porsonnel  FqulpmoiU  & Subsystt‘m  Test  & 
Evaluation 

PMD 

- 

PivKram  ManaRt'ment  Plreotlve 

»’MF 

- 

Precision  MeasurlnK  Equipment 

PMFl. 

- 

I’reclslon  MeasuiinR  Equipment  l.alxiratory 

PMP 

- 

I’lMRram  ManaRcn^ent  iMan 

POl, 

- 

I’etroleum,  Oil,  and  l.ubrlcants 

I’HU 

- 

Premature  Removal  Rate 

PSTF 

- 

I’ersonnel  Subsystems  Test  and  Evaluation 

»'\VC 

- 

Primary  Work  Center 

gpA 

- 

(.Quantity  Per  Apv>llcatlon  (ijuantlty  I’er  Articled 

QPPRl 

— 

Qualitative  and  Quantitative  I'ersonnel  Require- 
ments Information 

QUMK 

- 

Quality  Unsatisfactory  Materiel  Reports 

lUC 

- 

Reliability  Analysis  Center 

UCS 

- 

Report  Control  S>’mbol 

RFP 

- 

Request  for  Pivposal 

RC^C 

- 

Rtxiulred  Operational  Capability 

R&M 

- 

Reliability  and  Maintainability 

RPIF 

- 

Real  Property  Installed  Equipment 

RTS 

- 

Repaired  This  Station 

RUMR 

- 

Routine  Unsatisfactory  Materiel  Reports 

SAALC 

- 

San  Antonio  Air  Logistics  Center 

SAC 

- 

Strategic  Air  Command 

SAMSl'* 

- 

Space  and  Missile  Systems  Organl/.dion 

SRSS 

- 

Standard  Base  Supply  S>’stem 

SC  MS 

- 

Standard  Configuration  Management  Sv'stem 

SF 

- 

Support  Equipment 

SEDS 

- 

System  Effectiveness  Data  System 

Slop 

- 

Single  Integrated  Operational  Plan 

SISMS 

- 

Standard  Integrated  Svipport  Management  System 

SM 

- 

System  Manager 

SMAl.C 

— 

Sacramento  Air  Logistics  Center 

■) 
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Sourct'  Maintenance  HecoverabllUy  (Codel 

Separate  Operatlnn  Agency 

System  ProRram  dffloe 

Standard  UeportlnR  DeslRnator 

Shop  Itemovable  Unit  (Shop  Iteplaoeable  Unit) 

I'able  of  Allowances 

Tactical  Air  Command 

rime  Uetween  Overhaul 

Time  Compliance  Technical  larder 

Test  Directive 

Teardown  Deficiency  Report 

lest  and  Fvaluatlon  Obtectlves  Annex 

Type,  Model,  Series 

Technical  Order 

Test  Plan 

I’ransportatlon  PackaglnR  Orders 
Unit  Detail  Listing 
Unsatisfactory  Materiel  Report 
Work  Accomplished  Code 
Workload  Breakdown  Structure 
When  Dlsco'.ered  Code 

War  Reserve  Materiel  (War  Readiness  Materiel) 

War  Reserve  Spai'es  Kit  (War  Readiness 
Spares  Kit) 

World  Wide 

Dli'ectorate  of  Plans  and  Resources 


SMR 

StM 

SlH'i 

S1U1 

SRU 

TA 

I'AC 

TBl^ 

rcro 

TD 

TDR 

TKOA 

TMS 

I'O 

TP 

TPO 

UDL 

UMR 

WAC 

WBS 

WDC 

WRM 

WRSK 

WAV 

XR 


iai 


7-2.  TERMS  AND  DEFINITIONS. 
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a.  Data  Element  Definitions.  , 

(1)  Job  Control  Number/Report  Number  - A unique  number  assiRned 
and  used  to  control  and  tie  toRether  every  related  task  required  to  acconiidish  a | 

job.  Each  related  set  of  symptoms  that  comprises  a sinple  task  or  discrepancy 
is  defined  as  a job.  All  actions  taken  to  make  the  fix,  whether  on  the  line  or  at 
a base  shop  or  other  major  intermediate  repair  facility,  are  considered  part  of 
the  job  and  must  carry  the  same  number. 

(2j  Work  Center  - A flve-dlglt  code  that  identifies  organizational 
elements  to  which  maintenance  personnel  are  assigned,  or  locations  to  which 
they  may  be  dispatched. 

(.2)  Date,  This  Report  - Year,  month,  and  day  (may  be  written  day, 
month,  year)  the  report  was  initiated.  This  information  is  used  in  determining 
elapsed  time  in  eompleting  the  total  actions  relating  to  a single  job  control  num- 
ber, i.e.,  all  actions  from  the  line,  base  shop,  and  depot. 

p ! (4)  Activity  Identification  — Identification  of  the  base  in  possession  of 

I an  item. 

[ (5>  End  Item  (El)  Identification  — An  alphanumeric  designator  that 

^ identifies  an  item  as  a specific  type,  model,  and  series;  or  mission,  design, 

and  series.  This  identification  can  be  the  same  as  the  Standard  Reporting 
Designator  (SRD)  used  with  data  products  from  the  Standard  Rase  Supply 
^ System,  UlOSO-II. 

(R)  Serial  Number  El  - A unique  number  assigned  to  individual  items 
within  an  end  item  identification  scheme. 

, (7)  Possessed  Time  El  - That  interval  of  time  that  an  item  is  speci- 

fically assigned  to  an  operational  organization  for  the  accomplishment  of 
assigned  missions. 

(8)  Time/Miles/Cycles/Events  El  — A record  of  the  operating  life  of 
a serial  numbered  end  item  in  units  of  time,  miles,  cycles,  events  (as  appli- 

E cable  for  the  item)  at  the  time  of  failure  or  maintenance  action. 

(9)  Number  of  Landings  El  - A record  of  the  number  of  landings  made 
by  a specific  aerospace  vehicle. 

(10)  Number  of  Sorties  El  — The  cumulative  number  of  flights  of  a 
' single  aerospace  vehicle. 

' (11)  Date  of  Mission  - The  year,  month,  and  day  a given  mission  was 

started. 


I 


f 


■ I 


7-8 


mission. 


(12)  Start  of  Mission  (Time)  - The  clock  time  at  the  start  of  a given 


(13)  End  of  Mission  (Time)  - The  clock  time  at  the  end  of  a given 


mission. 

(14)  Mission  Type  - A unique  code  Identifier  for  the  type  of  mission 
being  accomplished  when  a malfunction  occurred. 

(15)  Operating  Modc/Mtssion  Phase  - A unique  code  identifying 
the  mode  of  operation  and/or  the  mission  phase  during  which  the  malfunction 
occurred. 

(Ifi)  Time  in  Each  Mode/Phase  - The  Intervals  of  time  that  items 
operate  in  each  mode  or  phase. 

(17)  Manufacturer  Failed  Item  (FI)  - Identification  of  manufacturer  by 
name  or  code,  as  provided  in  the  Federal  Stock  Catalog. 

(18)  Serial  Number  FI  - A unique  number  assigned  to  individual  items 
within  a functional  group  that  distinguishes  one  item  within  that  group  from 
another. 

(19)  Part  Number  FI  — Manufacturer's  number  assigned  to  individual 
items  or  equipment,  used  in  conjunction  with  manufacturer  and  serial  number  to 
track  a selected  item. 

(20)  Time/Miles/Cycles/Events  FI  — A record  of  the  operating  life  of 
a failed  item. 

(21)  Work  Unit  Code  (WUC)  - A five-digit  coding  structure  that 
identifies  an  item  on  which  maintenance  Is  performed;  usually  assigned  only  to 
repair  cycle  assets. 

(22)  When  Discovered  Code,  Date  and  Time  - A unique  code  designed 
to  identify  the  mode  of  operation  or  the  phase  of  maintenance  when  a discrepancy 
is  detected,  along  with  the  day,  month,  year,  and  clock  time  of  the  detection. 

(23)  How  Malfunctioned  Code  — A code  that  describes  the  physical 
defect  of  an  item  undergoing  maintenance,  as  determine  by  the  person  perform- 
ing the  maintenance.  This  code  Is  used  by  AFLC  in  conjunction  with  action 
taken  codes  to  determine  failures.  At  the  base  level,  only  how  malfunctioned 
codes  are  used  to  identify  failed  items. 

(24)  Action  Taken  Code  - A code  that  describes  the  type  of  mainte- 
nance action  accomplished  or  in  progress. 

(25)  Description  of  Problem  — A narrative  description  of  the  problem. 


addressing  what  comprises  the  malfunction. 
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(2fi)  Corrocttvx*  Action  (Malntonancp  Action  Tnkon)  - A narratlvi' 
lU'sorlpHon  of  tho  malntonanoo  actions  performotl  to  ropalr  the  fallod  Uom. 


(27)  Ploco  Parts  Itoplaced  - A listing  of  tho  fallod  Itoms  romovod 
from  and  roplacod  In  an  assombly  to  restore  It  to  a functional  oondltlon.  Only 
part  numbered  Items  or  items  with  a National  Item  Identlfleatlon  (NUN)  are 
listed. 

(28)  Units  Completed  - The  numlx>r  of  like  Items  wiu'ked  on  and 
actions  completed  for  a given  WUC. 

(29)  Manufacturer  Installed  Item  (11)  - Same  as  Item  (17). 

(20)  Serial  Numlxn-  ll  - Same  as  Item  (18). 

(21)  Part  Number  11  - Same  as  Item  (19). 

(22)  Tlme/Mlles/Cyelcs/Events  (U)  - A reeord  of  the  operating  life 
of  the  Installed  Item. 

(22)  Air  Porce  Speelalty  Code  (AFSC)  - A unique  identifier  that  indi- 
cates a person's  area  of  speelalt/atlon  ano  skill  level  associated  with  that 
specialty. 

(24)  Crew  Sl/.o  (by  AKSC)  - The  number  of  maintenance  personnel  by 
Air  Force  Specialty  Code  performing  a maintenance  action. 

(22)  Start  Time  (Maintenance)  - The  actual  clock  time,  to  the  nearest 
2 minutes,  at  which  a maintenance  notion  was  Initiated. 

(20)  Stop  rime  (Maintenance)  - The  actual  clock  time,  to  the  nearest 
2 minutes,  at  which  a maintenance  notion  was  terminated  for  any  reason  in 
excess  of  12  minutes. 

(27)  Delay  Code  - A unique  identifier  indicating  that  a maintenance 
task  has  been  delayed  for  some  particular  reason. 

(38)  Support,  General  Maintenance  - A coding  structure  that  Identifies 
support-type  maintenance  actions  such  ns  servicing.  Inspection,  towing,  wash- 
ing, cleaning,  corrosion  prevention,  handling,  preservation  and  depreservntlon 
of  equipment,  preparation  of  records  and  publications,  and  shop  support  func- 
tions. WUCs  OIXXX  through  09XXX  are  Included  in  this  category. 

(29)  Non-Support,  General  Maintenance  - A coding  structure  that 
Identifies  corrective  maintenance  actions  on  specific  WUCs,  as  well  as  other 
maintenance  actions  not  classified  as  support  types.  Included  are  WUCs  IIXXX 
through  99XXX. 

(40)  Type  Maintenance  Code  - A one-character  code  used  to  identify  the 
type  of  work  accomplished. 

h.  i>nrnmeter  neftnltions. 

(1)  Mean  Time  Between  Failures  (MTRF)  - For  a particular  time 
Interval,  the  total  operating  life  of  a population  of  a part,  component. 
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subassembly,  assembly,  subsystem,  or  system  divided  by  the  total  number  of 
failures  within  the  population.  This  definition  holds  for  operating  time,  flying 
time,  sorties,  events,  or  other  measures  of  the  life  units  to  be  applied  when  the 
system  operational  reliability  Is  being  evaluated.  It  Is  the  average  operating 
Interval  between  malfunctions  or  degraded  conditions  that  require  corrective 
maintenance. 

(2)  Failure  Rate  - The  number  of  failures  of  an  Item  per  unit  measure 
of  life  (cycles,  time,  miles,  events,  etc.,  as  applicable  for  the  Item).  For 
equipment  exhibiting  an  exponential  failure  distribution,  failure  rate  Is  the 
reciprocal  of  MTBF. 

(3)  Malfunction  Occurrence  Rates  (D056B5527). 

(a)  Total  Maintenance  Actlons/lOOO  Flight  Hours  are  all  occur- 
rences reported  under  all  valid  how  malfunctioned  codes  of  types  1,  2,  and  6, 
and  action  taken  codes  E,  F,  H,  J,  K,  L,  P,  R,  S,  U,  X,  and  Z.  (See 
appendix  4-2A  for  Information  concerning  these  codes.) 

(b)  Aborts/lOOO  Flight  Hours  are  expressed  as  a ratio  based 
upon  reported  actions  from  "on"  equipment  maintenance  Information.  They  are 
divided  Into  ground  and  flight  occurrences. 

(c)  Total  Aborts/lOOO  Sorties  Flown  Is  expressed  as  a rate  based 
upon  actions  from  "on"  equipment  maintenance  Information  covering  when  dis- 
covered codes  A and  C. 

(d)  Failure  Occurrences/lOOO  Operating  Hours  Is  expressed  as  a 
rate  based  on  occurrences  reported  against  equipment  that  operates  over  a time 
Interval. 

Ml  Percent  Failures  by  When  Discovered  Code  (D056B5527). 


(4)  Percent  Failures  by  When  Discovered  Code  (P056B5527). 

(a)  Before-Flight  failure  occurrences  are  accumulated  for  when 
discovered  codes  A and  B as  a fraction  of  total  occurrences,  and  converted  to  a 
percentage. 

(b)  In-Fllght  failure  occurrences  are  accumulated  for  when  dis- 
covered codes  C and  D as  a fraction  of  total  occurrences,  and  converted  to  a 
percentage. 

(c)  Between-Fllght  failure  occurrences  are  accumulated  for 
when  discovered  codes  E,  F,  G,  H,  J,  N,  V,  and  3 as  a fraction  of  total 
occurrences,  and  converted  to  a percentage. 

(d)  Durlng-Inspectlon  failure  occurrences  are  accumulated  for 
when  discovered  codes  K,  M,  P,  Q,  R,  T,  U,  W,  X,  Z,  2,  and  4 as  a fraction 
of  total  occurrences,  and  converted  to  a percentage.  (Note  that  failures  dis- 
covered during  basic  postfllght,  prefllght,  and  home-station  checks  are  Identified 
In  the  between-fllght  category. ) 

(5)  Mission  Reliability  - The  percentage  of  attempted  sorties  flown 
without  abort. 

(6)  Maintenance  Man-Hours/Fllght  Hour  - The  amount  of  direct 
maintenance  labor  expended  per  unit  of  time  the  aerospace  vehicle  Is  flown. 

This  parameter  may  Include  all  support  general  and  nonsupport  general 
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man-hours  or  only  03XXX  and  04XXX  coded  support  general  and  nonsupport 
general  man-hours  (see  appendix  4-2A). 

(7)  Maintenance  Man-Hours/Operatlng  Hour  - The  amount  of  direct 
maintenance  labor  expended  per  unit  o^  time  the  equipment  Is  operated. 

(81  MTTR  — The  total  corrective  maintenance  time  divided  by  the 
total  number  of  corrective  maintenance  occurrences  during  a given  period  of 
time.  This  parameter  Is  expressed  In  clock  hours. 

(9)  MMTR  — The  total  corrective  maintenance  man-hours  divided  by 
the  total  number  of  corrective  maintenance  occurrences  during  a given  time 
period. 

(10)  Mean  Time  Between  Maintenance  — The  mean  of  the  distribution 
of  the  time  Intervals  between  maintenance  actions. 

(11)  Mean  Active  Downtime  — The  average  clock  hours  between  sorties 
when  an  aerospace  vehicle  Is  not  flying,  or  the  average  clock  hours  that  an 
equipment  Is  not  operating  because  of  scheduled  and  unscheduled  maintenance, 
servicing,  supply,  and  administrative  delays. 

(12)  Not  Operationally  Ready,  Maintenance-Grounded  (NORM-G)  - 
The  aerospace  vehicle  requires  maintenance  that  must  be  performed  (scheduled 
or  unscheduled)  prior  to  flight.  This  category  includes  the  "look  and  fix"  phase 
of  maintenance  inspection  or  Time  Compliance  Technical  Order,  as  well  as 
after  a preflight,  through  flight,  home  station  check,  or  basic  postflight 
inspections. 

(1.3)  Not  Operationally  Ready,  Maintenance-Flyable  (NORM-F)  - The 
aerospace  vehicle  can  be  flown,  but  Is  not  capable  of  performing  all  of  its  com- 
mand assigned  missions  due  to  one  or  more  of  its  command  designated  systems 
or  subsystems  being  inoperative.  In  addition,  maintenance  must  either  be  in 
progress  or  have  been  deferred  for  reasons  other  than  lack  of  parts  or  supplies. 

(14)  Not  Repairable  This  Station  (NRTS)  - A code  for  off  equipment 
actions  that  Indicates  reasons  for  not  accomplishing  repairs  at  the  base  level 
maintenance  facility.  From  a maintainability  point  of  view  It  represents 
maintenance  man-hours  expended  In  determining  disposition  of  the  item  even 
though  repair  was  not  accomplished. 

(15)  Built-In  Test  Effectiveness  - The  adequacy  and  accuracy 
exhibited  by  the  built-in  test  equipment  with  respect  to  detecting  and  Isolating 
faults. 

(16)  Actuarial  Life  Expectancy  - The  operating  time  (flying  time)  that 
can  be  expected  from  an  item  before  It  falls  or  before  It  must  be  removed  and 
overhauled  to  bring  it  back  to  a llke-new  condition. 
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(17)  Operationally  Ready  Rate  - The  fraction  of  time  within  some 
specified  calendar  period,  that  an  item  is  capable  of  performing  all  its  assigned 
missions. 

(18)  Aircraft  Utilization  Rate  (Sortie  Rate)  - The  amount  of  time/ 
sorties  that  an  item  is  performing  Its  assigned  missions,  within  some  specified 
calendar  time  period. 

(19)  Item  On-Line  (Uptime)  - That  interval  of  time  during  which  an 
item  is  on  standby,  on  alert,  reacting  to,  or  performing  a mission. 

(20)  Not  Operationally  Ready,  Supply-Grounded  (NORS-G)  - The 
aerospace  vehicle  is  not  capable  of  flight  due  to  a verified  lack  of  parts.  This 
condition  is  applicable  only  if  a NORS  demand  has  been  placed  on  supply  and 
verified  in  accordance  with  standard  procedures. 

(21)  Not  Operationally  Ready,  Supply- Fly  able  (NORS-F)  — The  aero- 
space vehicle  can  be  flown,  but  is  not  capable  of  performing  all  its  command 
assigned  missions  due  to  one  or  more  of  its  Command-designated  systems  or 
subsystems  being  inoperative  and  parts  are  required  to  return  it  to  a fully 
operational  status.  This  condition  must  be  verified  as  for  a NORS-G 
designation. 

(22)  Repair  Capability  - The  percentage  of  components  delivered  to 
the  base-level  maintenance  function  for  repair  that  are  actually  repaired 
(repaired  units  plus  action  taken  codes  2 through  6). 

(23)  Reparable  Repair  Rate  - The  percentage  of  components  assigned 
to  base  level  maintenance  for  repair  that  are  actually  repaired  (repaired  units 
plus  action  taken  codes  1 through  9). 

(24)  Bench  Check  Serviceable  Rate  - The  percent  of  items,  removed 
from  the  end  item  for  which  the  suspected  failure  was  not  confirmed  during 
bench  check  using  available  skills,  test  equipment,  and  technical  data. 

(25)  Could  Not  Duplicate  Rate  - The  percentage  of  reported 
on-equipment  malfunctions  checked  and  found  to  require  no  further  maintenance 
action. 


(26)  Mean  Time  Between  Demand  - The  average  operating  time 
between  removals  of  components  for  suspected  failure,  with  failure  con- 
firmed during  bench  check. 

(27)  AGE  Utilization  Rate  - The  average  hours  per  month  that  aero- 
space ground  equipment  is  operated. 

(28)  Support  Equipment  Maintenance  Man-Hours  per  Operating  Hour  - 
The  direct  maintenance  labor  spent  on  maintenance  of  support  equipment  (AGE) 
per  unit  of  equipment  operating  time. 
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(29)  Precision  Moasuring  Equipment  (PMK)  No  Of  feet  liate  - The 
percentaRe  of  Instances  that  PME  are  round  to  be  defect-free  ciurinR  scheduled 
calibration,  compared  with  the  total  number  of  PMEs  calibrated  over  some 
time  span. 

(30)  Hequisitlon  Fill  Hates  — The  percentage  of  Instances  that 
requisitions  for  components,  modules,  repair  parts,  consumables,  etc. , are 
filled  by  base  supply  within  prescribed  time  limits,  compared  with  the  total 
number  of  requisitions  presented  to  base  supply  over  some  finite  time  span 
(weeks,  months,  etc.). 

(31)  Cannibalization  Itate  — A measure  of  the  on-equlpment  cannibaliza- 
tion actions  performed  to  keep  an  end  Item  In  an  operationally  ready  condition. 
The  rate  Is  expressed  as  average  cannlballzatlons  per  sortie. 

(32)  Maintenance  Plan  and  Support  Concept  Adequacy  - How  well  the 
maintenance  plan  and  support  concept  fulfills  the  needs  of  an  end  item  to  sustain 
an  operationally  ready  rate. 

(33)  Supply  Support  Adequacy  — The  capacity  of  supply  support  plan- 
ning and  Implementation  to  sustain  base-level  maintenance  requirements. 

(34)  Transportation/Handling  Adequacy  - The  sufficiency  of  the 
planning  and  Implementation  factors  associated  with  transportation  and  handling 
to  satisfy  end  Item  support  requirements. 

(35)  Technical  Data  Adequacy  — Adequacy  of  technical  data  to  support 
end  Item  maintenance  and  operation. 

(36)  Test  and  Support  Equipment  Adequacy  - The  capability  test  and 
support  planning  and  equipment  to  sustain  end  Item  operations. 

(37)  Support  Facilities  Adequacy  — The  capacity  of  available  support 
facilities  to  sustain  end  Item  operation. 

(38)  Training  Adequacy  - The  sufficiency  of  the  training  received  or 
planned  for  operation,  checkout,  and  maintenance  of  an  end  item. 

(39)  Initial  and  Replacement  Spares  Adequacy  - The  sufficiency,  with 
respect  to  sustaining  an  end  item  operationally  ready  rate,  of  planned  and  Imple- 
mented initial  and  replacement  parts  stockage  levels  for  maintenance  and 
repair.  (May  be  considered  an  element  of  Supply  Support.) 

(40)  Configuration  Management  Adequacy  - The  adequacy  of  the  con- 
figuration management  planning  and  the  practices  developed  and  Implemented 
for  an  end  item. 

(41)  Discrepancies  per  Scheduled  Inspection. 

(a)  Preflight  rates  are  calculated  for  occurrences  with  when 
discovered  code  J. 
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t (b)  Thru-  and  basic  post-flight  rates  are  calculated  for 

occurrences  with  when  discovered  code  H, 


(c)  Phase,  Isochronal,  etc. , rates  are  calculated  for  occurrences 
with  when  discovered  code  K,  M,  3,  and  4. 

(42)  Percent  Scheduled  Inspection  Man-Hours  - The  percentage  of 
total  man-hours  expended  against  when  discovered  codes  H,  J,  K,  M,  3 and  4. 

c.  Other  Definitions. 

(1)  Failure. 

(a)  The  D05fi  Data  System's  definition  describing  a failure 
occurrence  at  the  five-position  work  unit  code  level  is: 

U Any  type  1 how  malfunctioned  code  in  combination  with 
an  action  taken  code  of  F,  K,  L,  or  Z. 


2.  Any  type  1 how  malfunctioned  code  in  combination  with 
an  action  taken  code  of  P or  11,  provided  that  the  removed  item  was  not  found 
serviceable  (action  taken  code  B)  at  the  bench  check  station. 

NOTE ; A listing  of  how  malfunctioned  and  action 

taken  codes  is  provided  in  appendix  4-2A.  i 

(b)  The  criteria  describing  a failure  occurrence  and  the  accumu- 
lation of  failures  for  use  in  evaluating  data  at  the  system/subsystem  level 

(74XXX/741XX)  are  the  same  as  para.  7-2c(l)(a),  plus  action  taken  code  G j 

reported  in  combination  with  any  t3rpe  1 how  malfunctioned  code.  Accumulation  j 

of  failure  occurrences  as  related  to  action  taken  code  G for  evaluation  at  the 
system/subsystem  level  (74XXX/741XX)  is  further  limited  to  a count  of  one  per 
job  control  number  after  first  qualifying  as  an  occurrence. 

(c)  MDC  Failure  Categories. 

CODE  A DATA  CLASS  - FAILURE.  An  on-equlpment 
record  containing  a how  malfunctioned  code  other  than  those  listed  for  codes  B, 

C,  or  D below.  Only  code  A Is  used  In  determining  failure  data  for  the  perform- 
ance monitoring  system.  These  how  malfunctioned  codes  are  Included  in  the 
failure  count  unless  combined  with  action  taken  code  Q or  Y. 

» 

i 

2.  CODE  B DATA  CLASS  - INDUCED  FAILURE.  An 
on-equlpment  record  containing  how  malfunctioned  code  086,  092,  105,  106,  108, 

158,  167,  204,  230,  246,  301,  303,  447,  424,  518,  553,  602,  638,  639,  697,  698, 

709,  731,  750,  877,  878,  931,  or  342.  Code  B records  are  not  Included  in  the 
hlgh-25  on-equlpment  failure,  PCN  SG)J01B781. 

3.  CODE  C DATA  CLASS -NON-FAILUKES.  An 
on-equlpment  record  containing  how  malfunctioned  code  142,  143,  632,  796,  799, 

800,  803,  805,  812,  948,  or  804  and  type  maiutenance  not  "T"  or  "Z".  Also 
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IncUided  are  how  malfunctioned  codes  A or  B In  combination  with  action  taken 
codes  V or  H.  (Note:  IXl.lfi  includes  codes  142  and  143  as  type  1 failures.) 

4.  CODK  1)  DATA  CLASS  - NO  OFFKCT,  TCT(\  An 
on-equlpment  record  contjilnlnp  type  maintenance  code  T"  or  "7."  and  how  mal- 
functioned code  793,  797,  798,  801,  802,  804  or  911.  (Note:  See  appendix  4-2A 
for  MDCS  data  class  codes  and  how  malfunctioned  codes.) 

(2)  Other  Malfunctions  (1X130).  Other  malfunction  occurrences  are 
defined  as: 


(a)  Any  type  1 how  malfunctioned  code  In  combination  with  an 
action  taken  code  G at  the  five-position  work  unit  code  level.  At  the  system/ 
subsystem  (74XXX-741XX)  level,  a type  1 how  malfunctioned  code  with  an  action 
taken  code  G Is  accumulated  and  shown  as  a failure  and  not  as  another 
malfimctlon. 


(b)  Ty))c  2 how  malfunctioned  code  and  all  action  taken  codes 
listed  in  para.  7-2c(l)(a)  and  (b). 

NOTE : The  definitions  In  this  paragraph  apply  to  nor>fiRr)r)0r>, 
nOSfiBSOOfi,  and  D056B5527  products. 

(3)  Total  Occurrences  (D056)  — On-equlpment  occurrences  are 
reported  under  all  valid  how  malfunctioned  codes  (types  1,  2,  and  fi)  and  all 
action  taken  codes  listed  In  para.  7-2c(l)(a)  and  (b),  above,  plus  E,  H,  J,  S,  V, 
and  X.  This  expression  Is  used  In  the  DOSfiBSOOfi  for  Ml'BF.  Time  chang-c 
events  are  Included. 

(4)  Before  Flight  Abort  — For  an  attempted  sortie  that  does  not 
become  airborne  because  of  a failure,  the  criteria  used  will  be  that  applied  by 
the  predominant  using  command  for  operational  forces.  For  example,  in  TAC 
an  abort  occurs  when  an  aircraft  falls  to  take  off  within  2 hours  of  scheduled 
takeoff  time  due  to  maintenance  discrepancies  or  other  causes  discovered  or 
occurring  after  scheduled  aircrew  station  time.  For  determining  aborts,  the 
scheduled  takeoff  time  for  aircraft  is  that  agreed  upon  by  maintenance  and 
operations  prior  to  crew  arrival. 

(5)  Inflight  Alwrt  — An  airborne  aircraft  cannot  effectively 
accomplish  Its  primary  or  alternate  scheduled  mission  due  to  a reported 
malfunction. 

(fi)  Flight  Hours  — The  accumulation  of  all  flying  hours  readings  for 
some  specified  period  of  time, 

(7)  Use  Factor  - The  ratio  of  Item  operating  time  to  flying  time. 

(8)  Quantity  Per  Application  (Ql’A)  - The  numlx'r  of  identical  items 
of  the  work  unit  code  installcffon  the  specified  alrcraft/end  Item. 
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^ (J>)  tjuantlty  of  Knllurc  Occurrcncos  - Tho  accumulatlt'ii  of  falluro 

ooourivnoos  <lurinK  tho  samo  jH'rlod  covered  by  tho  oporatlnn  ttmo.  f 

1 (KH  Spooial  InvoiUory  — Accommoiiatos  lUfforont  wnflsuratlons  when 

atl  tost  aironift  ontt  Itoms  aro  tn>t  oqutppod  with  (»no  or  moro  partloular  work 
unit  oodod  oompononts. 

(ll>  Airornft/  Knd  Itom  Inventory  - Tho  numlH>r  of  airoraft/ond  itoms 
undor  tost. 

(12^  OporatlnK  rimo  - The  accumulation  of  actual  hours  that  an  item 
is  in  operation  based  on  F'l'I  readlnRs,  or  ptissossod  time  for  that  item.  When  | 

information  is  available,  NtMt  Ri-ounded  time  may  Ih>  subtracteii  from  possessed 
i time  to  determine  operatlnR  time,  when  operatlnR  time  Is  n<»t  rep('rte<i  I 

separately.  I 

Test  inventory  - The  total  numl>er  of  Items  under  test. 

(14)  On-Fquipment  Man-Hours  (IX~>r>(t>  - The  sum  of  all  on  t'qulpment 
lalior  expended  except  support  Renerat. 

4 

(ir»)  Off-Kquipment  Man-Hours,  or  Shop  Hours  (lX'>5r<)  - The  sum  of 
all  off-t>qulpment  labor  expended  In  work  vinlt  code  series  IIXXX  throuRh  90XXX. 

Kxcluded  are  support  general,  depot,  and  Items  withdrawn  from  supply  (when 
discovered  code  I")  actions. 

(Ifi)  Total  Man-Hours  (lX')5f>)  - The  sum  of  all  on-equipment  anil  off- 
equipment  maintenance  man-hours  as  oeflned  in  para.  r>-2o(l4)  and  (ir>)  alx^vo. 

(17)  On-Equipment  Man-Hours  (Except  IX^Sfi)  — Tho  sum  of 
on-equipment  lalx^r  expended  for  all  support  general  work  unit  or>dos  and  all 
on-equlpment  lal>or  oxviondod  on  work  unit  codes  requiring  preventive  and  tvr- 
reetlve  maintenance  actions. 

(18)  Off-Equipment  Man-ll^ours  (Shop  Hours,  except  “ 'I'hc  sum 

of  all  off-equlpment  lalxir  ex^iended  for  all  support  general  work  unit  codes  ami 
all  off-equlpment  labor  expended  on  work  unit  codes  requiring  corrective 
maintenance  actions. 

(19)  Totol  Man-Hours  (Except  D05fi)  - The  sum  of  all  on-equipment 

i and  off-equlpment  maintenance  man-hours  as  defined  In  para.  5-2e(17)  and 

(18)  above. 

I ' 

(20)  Total  Corrective  Maintenance  Man-Hours  — The  sum  of  all  off- 

* and  -on  ixiulpment  maintenance  man-hours  expended  on  work  unit  codes  IIXXX 

through  99XXXI  requiring  corrective  maintenance  actions. 

i (21)  Total  Corrective  Maintenance  Occurrences  - The  sum  of  the  unit 

count  for  all  tyi>e  1 and  2 how  malfunctioned  codes  in  combination  with  action 
1 taken  codes  A,  F,  tJ,  K,  I.,  P,  R,  V,  and  Z. 
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(22)  Total  Turnaround  Hours  - The  sum  of  all  scheduled  and 
unscheduled  on-equlpment  maintenance  time,  supply  and  administrative  delay 
time,  dead  shift  time,  inspections,  servicing  and  loading  time.  All  time  is 
expressed  in  clock  hours. 

(23)  NOUM-G  Hours  - The  sum  of  NORM-G  scheduled  and  unscheduled 
hours  for  the  test  Inventory  over  the  time  period  being  evaluated. 

(24)  Total  NORM  Hours  — The  sum  of  NORM-G  unscheduled  hours, 
NORM-G  scheduled  hours,  and  NORM-F  hours  for  the  test  Inventory  over  the 
time  period  under  evaluation. 

(25)  Aircraft  Hours  Possessed  — The  sum  of  the  total  clock  hours 
accumulated  for  the  test  inventory  during  the  time  period  associated  with  the 
evaluation. 

(2R)  Quantity  of  Maintenance  Occurrences  — The  sum  of  the 
on-equlpment  unit  count  for  all  how  malfunctioned  codes  (types  1,  2,  and  fi)  in 
combination  with  action  taken  codes  E,  F,  G,  H,  J,  K,  L,  P,  R,  S,  V,  X,  and 
Z during  the  same  time  period  covered  by  the  operating  time  with  the  "type 
maintenance  code"  criteria  of  para.  4-4b(l)(n)^  applied. 

(27)  Total  NRTS  Man-Hours  - The  sum  of  all  off-equipment  man-hours 
accumulated  for  action  taken  codes  1 through  9. 

(28)  Malfunctions  Detected/Isolated  - The  sum  of  the  successful 
attempts  of  the  BIT  to  detect/isolate  malfunctions  over  some  specific  time 
period. 


(29)  Total  Malfunctions  Indicated  — The  sum  of  all  malfunctions  indi- 
cated by  the  BIT  for  the  same  time  period. 

(30)  Total  Units  With  No  Defect  Found  - The  sum  of  the  unit  count  for 
all  BIT-lndlcated  failures  with  action  taken  code  H,  or  a combination  of  action 
taken  codes  P and  R with  action  taken  code  B. 

(31)  Item  Reaction  Time  - The  fraction  of  possessed  time  needed  to 
initiate  a mission,  measured  from  the  time  the  command  is  received. 

(32)  Item  Standby  Time  — The  fraction  of  possessed  time  that  an  aero- 
space vehicle  or  end  item  is  considered  ready  to  be  operated,  but  has  not  been 
activated  for  operation.  Items  that  fall  into  this  category  Include,  but  are  not 
limited  to,  AGE  and  CEM. 

(33)  Item  Alert  Time  - The  fraction  of  possessed  time  that  an  aero- 
space vehicle  is  in  an  operating  condition  and  is  ready  to  perform  its  specified 
mission  when  called  upon  to  so  do.  This  term  may  be  applied  to  items  other 
than  aerospace  vehicles  if  there  is  Indeed  an  alert  condition  associated  with 
equipment  operations. 
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(34)  Item  Downtime  — The  fraction  of  possessed  time  that  an  end  Item  I 

Is  not  available  to  perform  Its  mission  because  of  necessary  maintenance  or  j 

supply  actions.  The  sum  of  scheduled,  unscheduled,  and  delay  time  associated 

with  these  actions  comprise  downtime.  Downtime  is  applicable  to  all  end  items 
roRardless  of  their  operatlnR  characteristics. 

(35)  Total  NORS-O  Hours  — The  sum  of  all  NOltS-d  hours  for  all  air- 
craft under  test  over  the  time  span  of  the  evaluation  period. 

(36)  Total  NOltS  Hours  - The  sum  of  all  NOllS-d  and  NOltS-F  hours  for 
all  aircraft  under  test  over  the  time  span  of  the  evaluation  period. 

(37)  NOIIS  Hours  — The  sum  of  all  NOltS  hours  for  the  test  inventory 
over  the  time  period  of  the  evaluation. 

I 

(38)  Number  of  Sorties  (Hours)  Flown  — The  total  number  of  sorties  j 

(hours)  flown  durlnR  the  time  span  of  the  evaluation. 

(39)  Number  of  Maintenance  Days  — The  total  number  of  work  days  In  i 

the  time  span  of  the  e\'aluatlon.  ^ 

(40)  Serviceable  Units  — The  sum  of  all  off-equipment  action  taken 
code  B imlts  for  some  specific  time  period  (action  taken  codes  A,  F,  G,  K,  L, 

V,  Z). 

(41)  Repaired  Units  - The  sum  of  all  equipments  repaired  and  returned 
to  an  operating  condlton  over  the  same  period  of  time. 

(42)  On-Equlpment  Could  Not  Duplicate  Actions  - The  sum  of  the  unit 
coiuit  for  action  taken  codes  H and  J In  combination  with  when  discovered 
codes  A,  B,  C,  D,  E,  G,  N,  1',  and  2 over  some  specific  time  span. 

(43)  Operator  Reported  On-Equlpment  Actions  - The  sum  of  the  unit 
coimt  for  action  taken  codes  F,  G,  H,  J,  K,  L,  P,  R,  V,  X,  and  Z In  combina- 
tion with  when  discovered  codes  A,  B,  C,  D,  E,  G,  N,  P,  and  2 over  the  same 
specific  time  span. 

(44)  Total  Demand  Actions  — The  sum  of  the  unit  count  for 
on-equlpment  action  taken  codes  P and  R In  combination  with  all  type  I and  2 how 
malfunctioned  codes,  less  action  taken  code  B combined  with  how  malfunctioned 
code  799  over  some  specific  time  span.  (Note:  Time  change,  scheduled 
maintenance,  and  modification  removals  are  not  Included.) 

(45)  No  Defects  — The  number  of  PME  found  to  be  defect  free  during 
scheduled  callbi’atlon  accumulated  for  some  specific  time  period. 

(46)  Total  PME  Calibrated  — The  total  number  of  PME  processed  for 
calibration  over  the  same  time  period. 

(47)  Requisitions  Ellled  - The  sum  of  ris^ulsltlons  for  components, 
modules,  repair  parts,  consumables,  etc.,  that  are  filled  by  base  supply/ 
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contractor  within  prescribed  limits  over  some  specific  time  span.  Items 
withdrawn  from  an  established  bench  stock  are  not  Included. 

(48)  Total  Requisitions  - The  sum  of  all  requisitions  presented  to 
base  supply/contractor  over  the  same  specific  time  period. 

(49)  Cannibalization  Actions  — The  sum  of  all  on-equipment  action 
taken  codes  T accumulated  over  some  specific  time  period. 

(50)  Number  Returned  to  Service  (Engines)  - The  sum  of  all  engines 
returned  to  service  from  base  level  maintenance  over  some  specific  time 
period. 

(51)  Total  Removals  (Engines)  - The  sum  of  all  engines  removed 
over  the  same  time  period. 

(52)  Scheduled  Removals  (Engines)  - The  sum  of  all  engine  removals, 
on  a scheduled  basis,  over  the  same  time  period. 

(53)  Directed  Removals  (Engines)  — The  sum  of  all  directed  engine 
removals  over  the  same  time  period. 

(54)  End  Item  — An  entity  of  hardware  not  to  be  installed  in  another 
piece  of  equipment. 

(55)  On-Equipment  Actions  - Those  maintenance  actions  performed  on 
end  items  of  equipment. 

(56)  Off-Equipment  Actions  - Those  maintenance  actions  performed 
on  assemblies,  subassemblies  or  components  apart  from  an  end  item  of 
equipment. 

7-3.  REFERENCES. 

a.  Department  of  Defense  Directives. 

DoDD  4100.35  - Development  of  Integrated  Logistic  Support  for 
Systems/Equipment,  1 October  1970 

DoDD  4100. 39 -The  Defense  Integrated  Data  System  (DIDS), 

31  March  1972 

DoDD  5000.1  — Acquisition  of  Major  Defense  Systems,  13  July  1971 

DoDD  5000.3  -Test  and  Evaluation  12  April  1974 

DoDD  5000. 11  - Data  Elements  and  Data  Codes  Standardization 
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DoDD  5000.  26  - Defense  Systems  Acquisition  Review  Council  (DSARC) 

DoDD  5010. 19  - Configuration  Management,  17  July  1968 
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DoDD  5010.20  - Work  Breakdown  Structure  for  Defense  Materiel 
Items,  21  July  1908 
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19  April  1973 
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AFR  57-1  - Policies,  Responsibilities  and  Procedures  for 

Obtaining  New  and  Improved  Operational  Capabilities, 
17  August  1971 


AFR  05-110  - 


Standard  Aerospace  V'ehicle  and  Equipment 
Inventory,  Status  and  Utilization  Reporting, 
1 October  1975 


AFR  00-14  - Equipment  Maintenance  Policies,  Objectives  and 

Responsibilities,  5 February  1973 

AFR  71-1  - Packaging  Management  Objectives,  31  October  1974 

AFR  71-13  - Packaging  Improvement  Report,  31  October  1974 

AFR  80-2  - Documents  Used  in  the  Management  of  Air  Force 

Research  and  Development,  12  May  1909 
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AFR  80-5 


Reliability  and  Maintainability  Programs  for  Systems, 
Subsystems,  Equipment  and  Munitions,  2 July  1973 


AFR  80-14  - Test  and  Evaluation,  10  February  1975 

AFR  80-18  - Department  of  Defense  Engineering  for 

Transportability,  9 August  1971 


AFR  300-5  - 


Standardization  of  Data  Elements  and  Related 
Features,  31  July  1973 


AFR  310-1  — Management  of  Contractor  Data,  30  June  1969 

AFR  400-26  - Logistics  Support  for  Systems/Equipment  Test 
Programs,  15  July  1971 

AFR  400-46  - Increase  Reliability  of  Operational  Systems  (IROS) 
Progi'am,  18  March  1966 

AFR  800-2  - Program  Management,  16  March  1972 

AFR  800-8  - Integrated  Logistics  Support  (ILS)  Program  for 

Systems  and  Equipment,  27  July  1972 

AFR  800-12  - Acquisition  of  Support  Equipment,  20  May  1974 

AFR  800-15  - Human  Factors  Engineering  and  Management, 

1 October  1974 

Air  Force  Manuals. 

AFM  65-260  — Aerospace  Vehicle  Inventory  Status  and  Utilization 
Reporting,  1 September  1973 

AFM  65-265  — Communications,  - Electronics  - Meterological 
Status  Reporting,  1 September  1973 

AFM  65-272  — Trainer  Equipment,  Inventory,  Utilization  and 
Status  Reporting  System,  1 September  1973 

AFM  65-663  - Aerospace  Vehicle  Inventory  Status  and  Utilization 
Reporting  (AVTSURS)  DSD;  G033C.GU,  1 April  1976 

AFM  66-1  - Maintenance  Management,  1 May  1974 

AFM  66-18  — Engineering  and  Technical  Services  Management 
and  Control,  26  February  1973 

AFM  66-264  - Exception  Time  Accounting,  1 July  1975 

AFM  66-267  Maintenance  Data  Collection  System,  1 July  1975 
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AFM  r>r>-278  - Maintenance  ManaReinent  Information  and  Control 

System  (MMICS),  1 April  1975 

AFM  ()7-l  - USAF  Supply  Manual  (Vol  II,  Part  1,  28  April  1975), 

(Vol  n.  Part  2,  15  February  1975) 

AFM  75-1  — Transportation  of  Materiel,  50  November  1970 

AFM  171-114  - Base  Level  Inquiry  System  (BLIS),  50  January  1975 

AFM  171-200  — Aerospace  Vehicle  Status  lleportlnR  System, 

1 June  1972 

AFM  171-205  — (Iround  CEM  Equipment  Heportinp;  System, 

1 November  1972 

AFM  171-207  - Maintenance  Data  Collection  System,  1 July  1975 

AFM  171-272  — Trainer  Equipment,  Inventoi’y,  Utilization  and 
Status  lleportlnR  System,  22  November  1971 

AFM  177-380  - USAF  Standard  Base  Level  Maintenance  Cost 
System  (B3500),  1 July  1975 

AFM  500-4  — Data  Elements  and  Codes,  Volumes  111  and  XI, 

2 September  1974 

AFM  400-1  — Selective  Management  of  Propulsion  Units, 

31  October  1908 

Air  Force  Loelstlcs  Command  Documents. 


AFLCM  57-3 


AFLCIl  57-9 


AFLCll  57-27 


AFLCIl  .57-49 


AFLCll  00-15 


AFLCM  171-45 


— llecoverablc  Consumption  Item 
llequlrements  System,  25  September  1972 

— Initial  Spares  and  Repair  Parts  Policy, 

31  October  1972 

— Determination  of  Requirements  of  Initially 
Provisioned  Items,  17  January  1909 

— Computation  Procedures  for  Consumption 
Typo  Items  for  Communications  — 
Electronic  — MctcroloRlcal  Facilities, 

24  July  1909 

— Product  Performance,  23  AuRust  1974 

— Product  Performance  System, 

21  April  1971 
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AFLCM  171-229 


AFLC/AFSCM  375- 


AFLC/AFSCP  400-] 


AFLCR  400-16 


AFLCP  800-3 


AFLC/AFSCM  800- 


- Weapon  System  Reliability  Mathematical 
Model  Program,  4 August  1970 

7 - Configuration  Management  for  Systems, 

Equipment,  Munitions,  and  Computer 
Programs,  31  March  1971 

11  — Reliability  and  Maintainability  Data 
Sources,  August  1974 

— AFLC  Increase  Reliability  of  Operational 
Systems  (IROS)  Program,  18  January  1974 

— Logistics  Performance  Factors  in  Inte- 
grated Logistics  Support,  April  1973 

4 — Optimum  Repair  Level  Analysis  (ORLA), 

25  June  1971 


AFLC 


- Logistics  Support  Cost  Model  Users 
Handbook,  19  June  1975 


f.  Air  Force  Systems  Command  Documents. 


AFSC  MTD  69-1  - 


AFSC  DH  1-X 


AFSC  Form  258/258-4,  Maintenance  Data 
Recording  Procedures,  1 September  1974 

Checklist  of  General  Design  Criteria, 
January  1975 


AFSC  DH  1-6  — System  Safety,  January  1975 


AFSC  DH  2-X 


AFSC  DH  2-2 


Checklist  for  Aeronautical  Systems, 

January  1975 

Crew  Stations  and  Passenger  Accommodations, 
January  1975 


g.  Military  Standards  and  Handbooks. 


MIL-STD-105D  - 


MIL-STD-470 


MII.-STD-471A  - 


MIL-STD-480 


Sampling  Procedures  and  Tables  for  Inspection 
by  Attributes,  18  July  1961 

Maintainability  Program  Requirements, 

21  March  1966 

Maintainability  Verification/Demonstration/ 
Evaluation,  27  March  1973 

Configuration  Control,  Engineering  Changes, 
Deviations  and  Waivers,  30  October  1968 
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Mlli-STU— 181  - ConflRuratlon  Control,  rnRlnetMinn  ChaiiRos, 

IVvlntions  and  Waivers  (Short  Form),  18  Oct  1972 

MIL-STD— 182A  - ConfiRuratlon  Status  Aceounting  Data  Flements 

and  llolatcd  Features,  1 April  1971 

MIL-ST1)-4h;)  - Configuration  Management  Praetiees  for  Systems, 

K(|uipment,  Munitions  and  Computer  I’rograms, 

1 June  1971 

MII.-STD— 190  - Sj)eeiflcatlon  Fraotlees,  .'10  dctober  1908 

M1L-ST11-721B  - Definitions  of  Fffectlveness  Terms  for 

Uellablllty,  Maintainability,  Human  Factors,  and 
Safety,  10  March  1970 

Mn.-STD-78ni  - Uellablllty  Tests:  Fxponentlal  Distrilmtlon, 

28  July  1909 

MIL-STD-78.')A  - Uellablllty  Program  for  Systems  and  Fqulpmcnt 
Development  and  Production,  28  March  1909 

MIL-lIDRK-217n  - Uellablllty  Prediction  of  Flcctronic  Kqvdpment, 

20  September  1974 

MIIi-HDBK-472  - Maintainability  Prediction,  24  May  1900 
h.  Air  Force  Test  and  Kvaluatlon  Center  Documents. 

AFTECU  .0.0-1  - AFTEC  Operations  Regulation,  1 .\ugust  197.0 

AFTEC  - Cost  of  Ownership  Handbook  (No  Date) 

1.  Air  Force  Technical  Orders. 

TO  00-'20-l  - Preventive  Maintenance  Program  (ieneral 

Requirements  and  Procedures,  1 June  1974 

TO  00-20-2  - The  Maintenance  Data  Collection  System, 

1 July  1970 

TO  00-20-2-2  - On-Equipment  Maintenance  Documentation  for 

Aircraft;  Air  liaunched  Missiles;  Oround  l.aunched 
Missiles,  Except  ICBMs;  Drones;  and  Related 
Training  Equipment,  1 July  1970 

TO  00-20-2-4  - Maintenance  Documentation  for  In-Shop  Engine 

Maintenance,  1 July  1970 
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TO  00-20-2-5 


TO  00-20-2-0 


TO  00-20-2-7 

TO  00-20-2-0 

TO  00-20-2-10 


TO  00-20-2-13 


TO  00-20-4 
TO  00-20-5 

TO  00-20-fi 

TO  00-20-7 

TO  00-20-8 

TO  00-20-10-2 

TO  00-20-10-3 

TO  00-20-14 


On-Equipment  Maintenance  Ilocumentatlon  for 
ICBMs,  1 July  1975 

On-Equlpment  Maintenance  Documentation  Nuclear 
Ordnance  Commodity  Management  Materiel, 

Reentry  Vehicles  and  Reentry  Systems,  and 
Related  Test  and  Handling  Equipment,  1 July  1975 

On-Equlpment  Maintenance  Documentation  for  AOE, 
Trainers  and  Simulators,  1 July  1975 

On-Equlpment  Maintenance  Documentation  for 
Ground  CEM  Equipment,  1 July  1975 

Off-Equipment  Maintenance  Documentation  for 
Shop  Work,  Conventional  Munitions  and  I’ME, 

1 July  1975 

AFLC  Depot  and  Contractor  In-Shop  Maintenance 
Documentation  and  Contractor  Data  Submission, 

1 July  1975 

Configuration  Management  Systems,  1 June  1974 

Aircraft,  Drone  and  Air  T,aunched  Missile 
Inspections,  Flight  Reports,  and  Supporting 
Maintenance  Documents,  1 July  1975 

Inspection  System,  Documentation  and  Status 
Reporting  for  Ground-Launched  Missiles  and  Their 
Trainers,  AGE  and  Ground  CMF  Equipment, 

15  July  1975 

Inspection  System,  Documentation,  and  Status 
Reporting  for  AGE  and  Training  Equipment 
(Excluding  ICBMs) , 15  April  1975 

Inspection  System,  Documentation  and  Reporting 
for  Ground  CME  Equipment,  1 June  1974 

Reporting  Operating  Time  for  Selected  Items, 

15  July  1974 

Use  of  AFTO  Form  210E  for  Scheduled  Inspections 
of  Ground  CME  Equipment,  1 June  1973 

Air  Force  Metrology  and  Calibration  Program, 

1 July  1975 
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I.  OthtM*  Dooumcnts  and  Iteferenoes. 


Ah'  Forc'o  Flight  Test  Coater,  Machine  independent  System  Kffi>etlve- 
noss  Data  System  Manual,  (No  date) 

Di'fense  Science  Itoard  Report  of  Task  Ft>rce  on  r»>st  ami  F valuation, 
April  2,  15)71 

T&K  Guidelines  for  Airborne  FCM  Systems 

T&K  Guidelines  for  Common  Test  Gear 

T&K  Guidelines  for  Ground  Vehicle  Systems 

T&F  GuUlellnes  for  Command  and  Control  Systems 
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